arXiv Computation and Language By Taoyong Cui, Pinxian Zeng, Wanghan Xu, Hao Xiao, Shuhan Xue, Qiang Gao, Wanli Ouyang, Pheng Ann Heng, Zhenfei Yin, Yingcheng Wu, Ling Yang

RSI-Anything: Unlocking Recursive Self-Improvement with World Models

Read the original on arXiv Computation and Language →

RSI-Anything is a domain-general framework that leverages predictive world models to guide action and learning-data selection for recursive self-improvement. It uses observed feedback to improve policies or workflows and adapts world models conditionally, while component and compatibility checks control the retention of updated policy-model pairs. Across multiple domains—including code repair, GUI tasks, laboratory planning, reaction optimization, and immune‑science applications—RSI-Anything shows substantial performance gains, such as higher success rates, reduced actions, doubled planning scores, and superior yield compared to baseline methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
3d ago

RSI-Opt: Recursive Self-Improvement Optimizer Agents For Model Training

RSI-Opt introduces Recursive Self-Improvement Optimizer Agents that evolve their own training policies by accumulating knowledge from previous runs, including prompts, playbooks, optimizer code, and decision cadences. A meta‑agent rewrites and archives these policies, enabling reusable procedures and code that adapt to new tasks. Across multiple generations and tasks, RSI‑Opt improves optimizer performance, achieving higher z‑scores on evolution suites, better cross‑model transfer, and significant error reductions on PDE benchmarks compared to fixed‑prompt baselines.

By Binghang Lu, Yige Sun, Guang Lin
arXiv Machine Learning
Oct 8

RSIGym: A Flexible Environment for Recursive Self-Improvement

RSIGym is a new agent-native research environment built on Everything as a Service (EaaS) that exposes training, inference, rollout, evaluation, and sandbox execution through reusable services. It supports shared budget and permission controls for Data, Harness, and Joint improvement tracks, allowing agents to investigate individual interventions and jointly optimize data, training settings, and execution harnesses within the same environment. Using RSIGym, the Opus 5 model achieved the highest RSI-Index of 0.4809 across five benchmarks, improving performance on software engineering, terminal interaction, mathematics, scientific reasoning, and skill-based tasks.

By Fanqing Meng, Lingxiao Du, Haocheng Lu, Qiguang Chen, Ziqi Zhao, Zijian Wu, Jiayuan Zhuo, Mengkang Hu, Michael Qizhe Shieh
arXiv Computation and Language
Oct 9

Language Models as AI Research World Models

The paper proposes using language models as Research World Models (RWMs) to predict outcomes of experimental interventions across diverse research environments. By training on over 2,600 experimental records and 171,000 GPU‑hours, RWMs improve prediction accuracy within and across environments, reducing selection regret by up to 78% and boosting gains in multi‑round autoresearch. Ablation studies show that incorporating research knowledge yields greater benefits than merely changing the language model or increasing reasoning effort.

By Zijun Wang, Zewen Liu, Minhua Lin, Zhaotian Weng, Zhan Shi, Bing He, Yisi Sang, Dakuo Wang, Benoit Dumoulin, Wei Jin, Yuyin Zhou, Cihang Xie, Hanqing Lu