arXiv Machine Learning July 10, 2026 By Weiqi Wang, Xin Liu, Binxuan Huang, Hejie Cui, Rongzhi Zhang, Changlong Yu, Shuowei Jin, Jingfeng Yang, Qingyu Yin, Zhengyang Wang, Zheng Li, Yifan Gao, Priyanka Nigam, Bing Yin, Lihong Li, Yangqiu Song

HeaPA: Difficulty-Aware Heap Sampling and On-Policy Query Augmentation for LLM Reinforcement Learning

Read the original on arXiv Machine Learning →

arXiv:2601. 22448v2 Announce Type: replace Abstract: RLVR has become a standard recipe for training LLMs on reasoning tasks with verifiable outcomes, but when rollout generation dominates the cost, efficiency hinges on which prompts are sampled and when.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 9

sGPO: Trading Inference FLOPs for Training Efficiency in RLVR

arXiv:2606. 08854v1 Announce Type: cross Abstract: Standard Reinforcement Learning with Verifiable Rewards (RLVR) training allocates a fixed rollout budget to every query, without regard for what each query's difficulty means for the current policy.

By Shivchander Sudalairaj, Kai Xu, Akash Srivastava, Giorgio Giannone

reinforcement-learning

arXiv AI

4d ago

Where Does Staleness Accumulate? Pool Aware Effective Staleness Control for Asynchronous RL in LLM Post-Training

arXiv:2609.36830v1 Announce Type: new Abstract: Fully asynchronous reinforcement learning (RL) improves resource utilization in large language model post-training by overlapping rollout generation wi...

By Chenliang Li, Neiwen Ling, Zijun Wei, Alfredo Garcia

llms reinforcement-learning benchmarks

arXiv AI

2d ago

Finetuning with Sampling: SFT Learns Better Than You Think

arXiv:2610.02140v1 Announce Type: cross Abstract: Introducing new capabilities to frontier models has long been the goal of posttraining, which predominantly employs supervised finetuning (SFT) and r...

By Aayush Karan, Sitan Chen, Yilun Du

reinforcement-learning fine-tuning

arXiv AI

Sep 15

LIMBO: Lifelong Inference-Time Memory and Budget Optimization for LLM Agents

arXiv:2609.14138v1 Announce Type: cross Abstract: As LLM agents become integrated into increasingly complex workflows, they must continually acquire new capabilities while retaining competence on pre...

By Siddharth Sharma, Nilesh Prasad Pandey, Onat Gungor, Tajana Rosing

llms agents benchmarks

arXiv AI

Jun 2

RLVR without Ineffective Samples: Group Prioritized Off-Policy Optimization for LLM Reasoning

arXiv:2606. 01281v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs).

By Yixiu Mao, Yun Qu, Qi Wang, Heming Zou, Xiangyang Ji

llms reinforcement-learning fine-tuning benchmarks safety

arXiv AI

Jun 3

Aletheia: What Makes RLVR For Code Verifiers Tick?

arXiv:2601. 12186v3 Announce Type: replace-cross Abstract: Multi-domain thinking verifiers trained via Reinforcement Learning with Verifiable Rewards (RLVR) are a cornerstone of modern post-training.

By Vatsal Venkatkrishna, Indraneil Paul, Iryna Gurevych

reinforcement-learning

One email a morning, machine-written

Related stories

sGPO: Trading Inference FLOPs for Training Efficiency in RLVR

Where Does Staleness Accumulate? Pool Aware Effective Staleness Control for Asynchronous RL in LLM Post-Training

Finetuning with Sampling: SFT Learns Better Than You Think

LIMBO: Lifelong Inference-Time Memory and Budget Optimization for LLM Agents

RLVR without Ineffective Samples: Group Prioritized Off-Policy Optimization for LLM Reasoning

Aletheia: What Makes RLVR For Code Verifiers Tick?