Fine-tuning and adaptation

LoRA, PEFT, instruction tuning and domain adaptation — adapting a pretrained model without paying to train one.

8,117 stories · RSS feed

arXiv Machine Learning
1d ago

Orthogonal Model Merging

arXiv:2602.05943v2 Announce Type: replace Abstract: Merging finetuned Large Language Models (LLMs) has become increasingly important for integrating diverse capabilities into a single unified model....

By Sihan Yang, Kexuan Shi, Weiyang Liu