Hugging Face Trending Papers June 25, 2026

Reasoning Quality Emerges Early: Data Curation for Reasoning Models

Read the original on Hugging Face Trending Papers →

Supervised fine-tuning (SFT) on a small, high-quality set of long reasoning traces is an effective approach for eliciting strong reasoning capabilities in Large Language Models (LLMs). However, existing methods for curating high-quality SFT data rely heavily on strong reasoning models to filter examples based on diversity and difficulty, making the curation process costly while often yielding suboptimal data quality.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Machine Learning

Jun 26

Reasoning Quality Emerges Early: Data Curation for Reasoning Models

arXiv:2606. 26797v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) on a small, high-quality set of long reasoning traces is an effective approach for eliciting strong reasoning capabilities in Large Language Models (LLMs).

By Hongyi Henry Jin, Wenhan Yang, Meysam Ghaffari, Carlos Morato, Baharan Mirzasoleiman

llms fine-tuning data-engineering

arXiv AI

Jul 2

Predicting LLM Reasoning Performance with Small Proxy Model

arXiv:2509. 21013v4 Announce Type: replace-cross Abstract: Given the prohibitive cost of pre-training large language models, it is essential to leverage smaller proxy models to optimize datasets before scaling up.

By Woosung Koh, Juyoung Suk, Sungjun Han, Se-Young Yun, Jamin Shin

llms benchmarks safety

arXiv AI

Jul 14

Filtered Reasoning Score: Evaluating Reasoning Quality on a Model's Most-Confident Traces

arXiv:2604. 11996v2 Announce Type: replace-cross Abstract: Should we trust Large Language Models (LLMs) with high accuracy?

By Manas Pathak, Xingyao Chen, Shuozhe Li, Amy Zhang, Liu Leqi

llms benchmarks

arXiv AI

Sep 7

Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models

The paper surveys efficient reasoning in large language models, contrasting fast intuitive (System 1) and slow deep (System 2) reasoning. It analyzes why System 2 is computationally costly yet more accurate, and why System 1 is efficient but less effective. The survey covers causes of inefficiency, patterns of reasoning behavior, and potential solutions to balance performance and computational budgets, offering actionable insights and an open‑source repository for ongoing research.

By Rui Wang, Hongru Wang, Boyang Xue, Jianhui Pang, Shudong Liu, Yi Chen, Jiahao Qiu, Derek Fai Wong, Heng Ji, Kam-Fai Wong

llms

arXiv Machine Learning

Aug 11

Rethinking Reasoning with MDLMs: Early Exits, Post-hoc Reasoning, and Beyond

arXiv:2510. 19990v2 Announce Type: replace Abstract: The reasoning paradigm, where language models reason before answering, has enabled breakthroughs on tasks such as mathematical problem-solving.

By Zachary Horvitz, Raghav Singhal, Hao Zou, Carles Domingo-Enrich, Zhou Yu, Rajesh Ranganath, Kathleen McKeown

llms diffusion reinforcement-learning fine-tuning

arXiv Machine Learning

Jun 16

Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification

arXiv:2601. 22642v2 Announce Type: replace Abstract: Large Language Models (LLMs) show remarkable capabilities, yet their stochastic next-token prediction creates logical inconsistencies and reward hacking that formal symbolic systems avoid.

By Chuxue Cao, Jinluan Yang, Haoran Li, Kunhao Pan, Zijian Zhao, Zhengyu Chen, Yuchen Tian, Lijun Wu, Conghui He, Sirui Han, Yike Guo

llms fine-tuning benchmarks

One email a morning, machine-written

Related stories

Reasoning Quality Emerges Early: Data Curation for Reasoning Models

Predicting LLM Reasoning Performance with Small Proxy Model

Filtered Reasoning Score: Evaluating Reasoning Quality on a Model's Most-Confident Traces

Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models

Rethinking Reasoning with MDLMs: Early Exits, Post-hoc Reasoning, and Beyond

Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification