Hugging Face Trending Papers June 3, 2026

Learning What to Learn: Stage-Specific Data Sets for SFT-then-RL in Small Language Model Reasoning

Read the original on Hugging Face Trending Papers →

Post-training Small Language Models (SLMs) for reasoning typically follows an SFT-then-RL pipeline, yet existing work rarely considers what data should be learned at each stage. We argue that data strategy should be aligned with the distinct roles of SFT and RL: SFT is better suited for acquiring not-yet-mastered reasoning skills, while RL is better suited for consolidating skills that the model can already partially access.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI

Aug 25

Is Next-Chunk Reasoning RL Really Better than SFT? Revisiting Training Strategies under no-CoT Data

arXiv:2608.23256v1 Announce Type: new Abstract: Recent work proposes next-chunk reasoning RL for leveraging no-CoT data---corpora such as worked solutions and textbook derivations that contain reason...

By Yinhao Tang, Youqing Fang, Yanan Sun, Jiangning Liu, Ziyi Wang, Xun Zhao, Weiming Zhang, Bin Liu, Kuikun Liu, Wenwei Zhang, Kai Chen

reinforcement-learning fine-tuning

arXiv Machine Learning

Jul 17

Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation

arXiv:2607. 14895v1 Announce Type: new Abstract: Reasoning language models (RLMs) have demonstrated impressive performance in domains such as mathematics and coding.

By Yu-Du Feng, Niels M\"undler-Sasahara, Mark Vero, Martin Vechev

llms nlp reinforcement-learning fine-tuning

arXiv Machine Learning

Sep 10

Apriel-Reasoner: RL Post-Training for General-Purpose and Efficient Reasoning

arXiv:2604.02007v3 Announce Type: replace Abstract: Building general-purpose reasoning models using reinforcement learning with verifiable rewards (RLVR) across diverse domains has been widely adopte...

By Rafael Pardinas, Ehsan Kamalloo, David Vazquez, Alexandre Drouin

llms agents reinforcement-learning benchmarks

Hugging Face Trending Papers

Jun 22

Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficiently

Recent advances in large language models (LLMs) have demonstrated that reinforcement fine-tuning of pretrained base models can lead to significant gains in reasoning performance at inference time. In this work, we theoretically analyze why reinforcement fine-tuning induces better reasoning ability than purely supervised fine-tuning (SFT) methods.

llms reinforcement-learning fine-tuning

arXiv AI

Jul 2

Predicting LLM Reasoning Performance with Small Proxy Model

arXiv:2509. 21013v4 Announce Type: replace-cross Abstract: Given the prohibitive cost of pre-training large language models, it is essential to leverage smaller proxy models to optimize datasets before scaling up.

By Woosung Koh, Juyoung Suk, Sungjun Han, Se-Young Yun, Jamin Shin

llms benchmarks safety

arXiv AI

Jun 8

CORE: Contrastive Reflection Enables Rapid Improvements in Reasoning

arXiv:2605. 28742v2 Announce Type: replace Abstract: Language models can use verifiable rewards to improve at a wide variety of reasoning tasks.

By Linas Nasvytis, Simon Jerome Han, Ben Prystawski, Satchel Grant, Noah D. Goodman, Judith E. Fan

llms rag

One email a morning, machine-written

Related stories

Is Next-Chunk Reasoning RL Really Better than SFT? Revisiting Training Strategies under no-CoT Data

Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation

Apriel-Reasoner: RL Post-Training for General-Purpose and Efficient Reasoning

Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficiently

Predicting LLM Reasoning Performance with Small Proxy Model

CORE: Contrastive Reflection Enables Rapid Improvements in Reasoning