SWE-Prime introduces a two-stage supervised fine-tuning data selection process for large language models tackling software issues. The first stage filters entire trajectories by quality and representativeness, while the second stage selects meaningful semantic segments based on contribution, learnability, and risk. Experiments on SWE-Bench Pro and Verified demonstrate that training on just 10% of trajectories chosen by SWE-Prime surpasses full-dataset training, achieving up to 12.2% and 24.2% performance gains.
By Dewu Zheng, Ruizhe Ye, Yanlin Wang, Yang Ye, Hongyu Zhang, Ensheng Shi, Xilin Liu, Yuchi Ma, Jianxing Yu, Zibin Zheng
arXiv:2609.01244v1 Announce Type: new
Abstract: Every supervised fine-tuning run forces the same chain of decisions, such as learning rate, batch size, LoRA or full fine-tuning, how many epochs, whic...
By Charles O'Neill, Mudith Jayasekara, Harry Partridge
SWE-Prime introduces a two‑stage, multi‑granularity supervised fine‑tuning (SFT) data selection process for large language models tackling real‑world software problems. The first stage filters entire trajectories based on process quality, result quality, and representativeness, while the second stage evaluates semantic segments for contribution, learnability, and risk, keeping all segments in context but only penalizing selected ones during training. Experiments on SWE‑Bench Pro and Verified demonstrate that training on just 10% of trajectories chosen by SWE‑Prime outperforms full‑dataset training, achieving up to 12.2% and 24.2% relative gains.
arXiv:2609.18417v1 Announce Type: new
Abstract: Multi-turn agent trajectories often contain redundant rounds (failed tool calls, parallel sub-queries, verification-only steps) that inflate both train...
By Zhuo Chen, Zhen Zhang, Xinyu Wang, Kewei Tu
Every supervised fine-tuning run forces the same chain of decisions, such as learning rate, batch size, LoRA or full fine-tuning, how many epochs, which optimiser, and what data to feed the model. Eac...
arXiv:2607. 20499v1 Announce Type: new Abstract: Large Language Models generate plausible backend code, but a single-pass paradigm provides no guarantee of correctness or runtime reliability.
By Sai Deekshith Lekkala, Jothi Prabha Appadurai, Rohith Reddy Bellibatlu, Manpreet Singh