arXiv AI
Geometric Calibration of Supervised Fine-Tuning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
6d ago
Geometric Calibration of Supervised Fine-Tuning
Recent studies investigate the weight geometry through its spectral structure, which characterizes how the weights transform different input directions. Within this view, supervised fine-tuning (SFT)...
arXiv AI
Oct 7
Harmful SFT Leaves a Continuous Trace in LLM Checkpoint Updates
arXiv:2610.07518v1 Announce Type: cross Abstract: Safety auditing of post-trained large language models typically relies on model behavior, requiring model execution and depending on the coverage of...
arXiv AI
Sep 30
From Checkpoint Variation to Selection Gains in Supervised Fine-Tuning
arXiv:2609.36569v1 Announce Type: cross Abstract: Checkpoint selection is a routine decision in supervised fine-tuning (SFT): training produces multiple checkpoints, but only one is retained. Yet fix...
arXiv Machine Learning
Jun 19
Model soups need only one ingredient
arXiv:2602. 09689v2 Announce Type: replace Abstract: Fine-tuning large pre-trained models on a target distribution often improves in-distribution (ID) accuracy, but at the cost of out-of-distribution (OOD) robustness as representations specialize to the fine-tuning data.
arXiv AI
Sep 16
ReDraft, Don't Just Distill: Reference-Driven Revision for Continual VLLM Post-Training
ReDraft is a reference‑driven revision method for continual post‑training of large multimodal language models. It uses the model’s own incorrect outputs as references, revises them, verifies the revisions, and fine‑tunes on the accepted ones, thereby combining explicit supervision with policy proximity. On tasks such as Counting, Clock Reading, and Jigsaw, ReDraft outperforms standard supervised fine‑tuning and on‑policy methods, achieving higher target‑task gains while dramatically reducing forgetting.
arXiv Machine Learning
Jun 4
RL Excursions during Pre-Training: Re-examining Policy Optimization for LLM training
arXiv:2606. 04272v1 Announce Type: new Abstract: The standard LLM training pipeline applies reinforcement learning (RL) only after pre-training and supervised fine-tuning (SFT).