The paper introduces "environment evolution," a method that incrementally raises the difficulty of interactive environments off‑policy, scheduling their generation across training generations to supply continuous learning signals. It derives three evolution directions tied to a multi‑turn learning objective and implements them via a loop‑engineered multi‑agent harness. Experiments with models such as Hy4 preview, Claude Opus 5, GPT‑5.6 Sol, Qwen3.6‑27B, and Qwen3.6‑35B‑A3B demonstrate that this approach consistently creates harder environments and boosts terminal‑agent performance on Terminal‑Bench 2.1 by 14.4–18.0 percentage points.
By Zhiyuan Fan, Tinghao Yu, Yuanjun Cai, Jiang Zhou, Jiangtao Guan, Jincheng Liu, Yun Yang, Dingxin Hu, Zhuo Han, Xing Wu, Feng Zhang, Lilin Wang
arXiv:2606. 03108v1 Announce Type: new Abstract: Autonomous LLM training is often framed as recipe search, which leaves the training harness largely static.
By Guhong Chen, Yingcheng Shi, Yongbin Li, Binhua Li, Xander Xu, Hu Wei, Shiwen Ni, Min Yang, Jieping Ye
The paper introduces "environment evolution," a method that incrementally raises the difficulty of interactive environments for terminal agents using off‑policy updates. It derives three evolution directions tied to a multi‑turn learning objective and implements them via a loop‑engineered multi‑agent harness. Experiments with models such as Hy4 preview, Claude Opus 5, GPT‑5.6 Sol, Qwen3.6‑27B, and Qwen3.6‑35B‑A3B demonstrate that this approach consistently generates harder environments and yields significant performance gains on Terminal‑Bench 2.1.
The paper introduces Algorithm Modelization, a paradigm that transforms iterative optimization algorithms into trainable models by treating algorithm execution trajectories as computational experience. It models optimization as an autoregressive process, using a dimension‑independent population‑temporal architecture to capture population interactions and iterative dynamics. The resulting model learns from heterogeneous teachers, improves through optimization feedback, and generalizes across problems and larger dimensions, enabling algorithmic capability to accumulate and evolve via learning.
By Jian Yao, Zhiyao Zhang, Yichen Li, Xingyu Wu, Kay Chen Tan
arXiv:2607. 21971v1 Announce Type: new Abstract: Test-time scaling through iterative self-evolution with environment feedback, as demonstrated by AlphaEvolve, shows remarkable performance gains.
By Shujin Wu, Cheng Qian, Xiusi Chen, Heng Ji
arXiv:2609.22592v1 Announce Type: cross
Abstract: Training agents with reinforcement learning requires a gym, comprising a task, an executable environment in which the task can be attempted, and a ve...
By Aarati Andrea Noronha, Kavya Ravikumar, Carly Xiaoyu Lin