Hugging Face Trending Papers
Post-Training Science for Supervised Fine-Tuning
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv Machine Learning
Sep 2
Post-Training Science for Supervised Fine-Tuning
arXiv:2609.01244v1 Announce Type: new Abstract: Every supervised fine-tuning run forces the same chain of decisions, such as learning rate, batch size, LoRA or full fine-tuning, how many epochs, whic...
arXiv Computation and Language
Sep 24
Can One Adapted Model Do It All? Fine-Tuning Strategy Selection for Customer Support LLMs
The study evaluates whether a single large language model (LLM) can handle multiple customer‑support tasks or if separate specialist models are preferable. Using 13 models from five families and 200+ checkpoints across eight datasets, the authors find that multi‑task full fine‑tuning consistently outperforms other strategies. They also show that sequential LoRA and model merging can preserve earlier skills and improve off‑task robustness, offering practical guidelines for real‑world deployment.
arXiv AI
Oct 21
The Shape of the DPO Hyperparameter Landscape: What to Measure, How It Moves with Scale, and When Not to Transfer It
arXiv:2610.27895v1 Announce Type: cross Abstract: Direct preference optimisation (DPO) is widely used for language model post-training, but its performance depends strongly on the choice of its hyper...
arXiv AI
Jun 11
Soft-Prompt Tuning for Fair and Efficient LLM Benchmark Evaluation
arXiv:2606. 12117v1 Announce Type: cross Abstract: Benchmark scores often misrepresent a large language model's (LLM's) knowledge, because they rely, e.
arXiv AI
Jun 3
q0: Primitives for Hyper-Epoch Pretraining
arXiv:2606. 03938v1 Announce Type: cross Abstract: Multi-epoch training is becoming the standard now that compute is growing faster than the supply of high-quality text.
arXiv AI
Oct 1
Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation
arXiv:2605.07111v3 Announce Type: replace-cross Abstract: Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides greater represe...