arXiv Machine Learning By Ngoc-Hieu Nguyen, Parshin Shojaee, Phuc Minh Nguyen, Nan Zhang, Chandan K Reddy, Khoa D Doan, Rui Zhang

Why Do Reasoning Models Lose Coverage? The Role of Data and Forks in the Road

Read the original on arXiv Machine Learning →

The paper investigates why fine‑tuned reasoning models lose coverage, observing that pass@k accuracy degrades relative to the base model. The authors attribute this shrinkage to decision‑point or “forks in the road” scenarios in the fine‑tuning data, where the model faces multiple valid reasoning paths. Controlled experiments confirm a strong correlation between such decision‑point prevalence and coverage loss, and show that targeted data synthesis and diversity‑encouraging decoding can partially mitigate the effect.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 17

Know Thy Reasoner: Not All Language Models Explore Alike

arXiv:2604. 10827v2 Announce Type: replace Abstract: Compute scaling for LLM reasoning trades off exploring solution approaches (\emph{breadth}) against refining promising ones (\emph{depth}), yet why a given trade-off works, and why it often fails to transfer across models, remains unclear.

By Moulik Choraria, Argyrios Gerogiannis, Anirban Das, Supriyo Chakraborty, Sourya Basu, Sambit Sahu, Lav R. Varshney
Hugging Face Trending Papers
Jun 25

Reasoning Quality Emerges Early: Data Curation for Reasoning Models

Supervised fine-tuning (SFT) on a small, high-quality set of long reasoning traces is an effective approach for eliciting strong reasoning capabilities in Large Language Models (LLMs). However, existing methods for curating high-quality SFT data rely heavily on strong reasoning models to filter examples based on diversity and difficulty, making the curation process costly while often yielding suboptimal data quality.