arXiv Machine Learning August 4, 2026 By Longtian Bao, Jianyou Wang, Yang Zhang, Youze Zheng, Ramamohan Paturi

Question Begets Question: Self-Evolving Curriculum for Reinforcement Fine-Tuning on Competition Mathematics

Read the original on arXiv Machine Learning →

arXiv:2608. 01522v1 Announce Type: new Abstract: Teaching a language model a skill it has not mastered is obstructed by three recurring difficulties: training data is scarce, ground-truth reasoning traces are usually unavailable, and models often exhibit an apparent ceiling beyond which additional data yields no further improvement.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 10

Ask-E: An Environment for Calibrated Question Generation

arXiv:2608. 06933v1 Announce Type: cross Abstract: Today, we improve models by training and evaluating them on problems at the frontier of their abilities.

By Sarah Pratt, Jae Sung Park, Scott Geng, Ali Farhadi

llms benchmarks

arXiv Machine Learning

Jul 1

Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability

arXiv:2601. 18778v3 Announce Type: replace Abstract: RL methods for scaling large reasoning models stall on datasets with low initial success rates, and thus little training signal.

By Shobhita Sundaram, John Quan, Ariel Kwiatkowski, Kartik Ahuja, Yann Ollivier, Julia Kempe

llms reinforcement-learning benchmarks

arXiv AI

Jun 9

CLPO: Curriculum Learning meets Policy Optimization for LLM Reasoning

arXiv:2509. 25004v2 Announce Type: replace Abstract: Online reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving the reasoning abilities of large language models, but most methods still optimize reasoning trajectories over the static problem set, wasting rollout budget on solved or overly difficult problems.

By Shijie Zhang, Zheng Xiao, Shiyu Liu, Guohao Sun, Kevin Zhang, Xiang Guo, Rujun Guo, Shaoyu Liu, Wangxiao Zhao, Guanjun Jiang

llms reinforcement-learning benchmarks

arXiv AI

Jul 20

Understanding Reasoning from Pretraining to Post-Training

arXiv:2607. 16097v1 Announce Type: cross Abstract: Reinforcement learning (RL) has become central to improving large language models (LLMs) on complex reasoning tasks, yet RL post-training is largely studied in isolation from the pretraining that precedes it.

By Jingyan Shen, Ang Li, Salman Rahman, Yifan Sun, Micah Goldblum, Matus Telgarsky, Pavel Izmailov

llms reinforcement-learning fine-tuning

arXiv AI

Jun 9

INFUSER: Influence-Guided Self-Evolution Improves Reasoning

arXiv:2606. 09052v1 Announce Type: cross Abstract: Self-evolution offers a scalable path to stronger reasoning: a pretrained language model improves itself with only minimal external supervision.

By Siyu Chen, Miao Lu, Beining Wu, Heejune Sheen, Fengzhuo Zhang, Shuangning Li, Zhiyuan Li, Jose Blanchet, Tianhao Wang, Zhuoran Yang

llms benchmarks

arXiv AI

Jul 14

BRIDGE: Bridging Reasoning In Distillation Gap Elimination via Structure-Aware Masking

arXiv:2602. 17686v5 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) reasoning has significantly improved LLMs' mathematical problem-solving capabilities, but distilling such capabilities into smaller models remains challenging due to the capacity mismatch between verbose teachers and compact students.

By Bowen Yu, Sheng Zhang, Binhao Wang, Yi Wen, Jingtong Gao, Bowen Liu, Zimo Zhao, Shanshan Ye, Wanyu Wang, Maolin Wang, Xiangyu Zhao

llms reinforcement-learning efficiency safety

Related stories

Ask-E: An Environment for Calibrated Question Generation

Teaching Models to Teach Themselves: Reasoning at the Edge of Learnability

CLPO: Curriculum Learning meets Policy Optimization for LLM Reasoning

Understanding Reasoning from Pretraining to Post-Training

INFUSER: Influence-Guided Self-Evolution Improves Reasoning

BRIDGE: Bridging Reasoning In Distillation Gap Elimination via Structure-Aware Masking