Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,201 stories · RSS feed

arXiv Computation and Language
Oct 8

CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution

arXiv:2610.10426v1 Announce Type: new Abstract: Terminal-agent capability depends jointly on model weights and the runtime harness that formats prompts, binds tools, and handles error recovery. Exist...

By Jixuan Chen, Jiaxin Zhang, Qinyuan Ye, Yada Pruksachatkun, Haoxiang Zhang, Jingming Zhuo, Yifan Zhang, Yutong Dai, Juntao Tan, Xiangyu Peng, Silvio Savarese, Zeyuan Chen, Lianhui Qin, Chien-Sheng Wu
arXiv Machine Learning
Oct 8

MorphCL: Morphological Contrastive Learning for Inertial-based Human Activity Recognition

MorphCL introduces a self‑supervised pretraining framework for inertial‑based human activity recognition that explicitly models global motion structure through morphology‑aware grouping. By leveraging motion primitives and domain‑specific descriptors, MorphCL improves linear probing and fine‑tuning performance of encoders by up to 15 percentage points in F1‑score. Compared with existing foundation models, MorphCL‑pretrained encoders achieve comparable or better linear probing results while using 4,600× less data, and the learned embeddings exhibit clear, morphologically meaningful clusters that better separate kinematically similar activities.

By Marius Bock, Yuwei Zhang, Juergen Gall, Michael Moeller, Kristof Van Laerhoven, Cecilia Mascolo
arXiv Computation and Language
Oct 8

Beyond Captions: Context-Grounded Reconstruction for Biomedical Multimodal Continued Pretraining

arXiv:2606.01049v3 Announce Type: replace Abstract: Biomedical figures are explained not by captions alone but by body-text passages that discuss them. Yet current multimodal corpora typically reduce...

By Guanghao Zhu, Zeyu Liu, Zhitian Hou, Pengkai Wang, Zhijie Sang, Yang Yu, Minheng Ni, Wenjun Wang, Yanggan Gu, Shuo Cai, Congkai Xie, Jianmin Wu, Hongxia Yang
arXiv Computation and Language
Oct 8

InfiMed2: A Generalist Medical Multimodal Foundation Model from Contextual Evidence and Stability-Aware Supervision

arXiv:2609.34798v2 Announce Type: replace Abstract: Recent medical multimodal models have benefited from larger corpora, broader modality coverage, and stronger reasoning-oriented training, yet effec...

By Guanghao Zhu, Zeyu Liu, Zhitian Hou, Pengkai Wang, Zhijie Sang, Shuo Cai, Yang Yu, Yuanyi Wang, Yanggan Gu, Congkai Xie, Jianmin Wu, Hongxia Yang