arXiv AI
Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Aug 31
Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence
Recent advances in large reasoning models (LRMs) have shown that reinforcement learning with verifiable rewards (RLVR) can substantially improve reasoning in mathematics and code, where outcomes can b...
arXiv AI
Sep 10
Boosting LLM Reasoning via Human-Inspired Reward Shaping
The paper introduces T2T (Thickening-to-Thinning), a dynamic reward framework for large language models that mimics human learning by separating exploration and consolidation phases. During incorrect attempts, T2T encourages exploration to broaden the search space, while after correct solutions it applies length penalties to promote concise reasoning. Experiments on mathematical benchmarks across five mainstream LLMs show that T2T outperforms standard GRPO and recent baselines, improving overall reasoning performance.
arXiv Machine Learning
Sep 23
Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
Agent0 is a fully autonomous framework that enables large language model agents to evolve without external data by using a multi‑step co‑evolution process. It pits a curriculum agent against an executor agent, both derived from the same base LLM, where the curriculum agent creates increasingly challenging tasks and the executor learns to solve them. By integrating external tools into the executor’s workflow, the system creates a self‑reinforcing cycle that continuously generates high‑quality curricula, leading to significant gains in reasoning performance—an 18% improvement on mathematical reasoning and 24% on general reasoning for the Qwen3‑8B‑Base model.
arXiv AI
Oct 12
MENTOR: Learning from Failure with On-Policy Pedagogical Intervention
The paper introduces MENTOR, a multi‑agent framework that provides on‑policy pedagogical intervention to address zero‑reward collapse in reinforcement learning from verifiable rewards. MENTOR diagnoses failures in real time and generates targeted prompts to guide the learning agent, integrating seamlessly with existing policy optimization pipelines such as GRPO. Experiments on math and code generation tasks show that MENTOR significantly reduces collapse, achieving up to 78.3% relative gains on Llama‑3.2‑3B‑Instruct.
arXiv AI
Jun 9
CLPO: Curriculum Learning meets Policy Optimization for LLM Reasoning
arXiv:2509. 25004v2 Announce Type: replace Abstract: Online reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving the reasoning abilities of large language models, but most methods still optimize reasoning trajectories over the static problem set, wasting rollout budget on solved or overly difficult problems.
arXiv AI
Jul 28
From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement
arXiv:2607. 23802v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has driven recent progress in reasoning-oriented large language models (LLMs) by enabling large-scale optimization.