arXiv AI
From Existing Methods to New Research Ideas: Two Perspectives on Recursive Self-Improvement
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Sep 23
Recursive self-improvement of AI research agents
The paper introduces AIDE^2, an AI research agent that recursively improves its own code by proposing, benchmarking, and selecting modifications. Over an eight‑day autonomous run, it achieved seven successive improvements—including new search policies and memory mechanisms—that transferred to four held‑out benchmarks in machine learning, algorithm engineering, and weather forecasting. The agent’s best version matched or outperformed a top human‑engineered production research agent and also reduced reward‑hacking rates, despite never optimizing for that metric.
arXiv AI
Oct 1
Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer
The paper introduces a self‑evolving harness framework where a frozen language‑model agent first solves tasks and then edits its own harness based on run records. Using a 49‑line seed harness, the evolved harness improves average scores on in‑distribution benchmarks by 4.48 points and on out‑of‑distribution benchmarks by 12.64 points, surpassing Codex on the former and matching it on the latter. Continued evolution on a specific out‑of‑distribution benchmark further raises performance, and the study analyzes emergent mechanisms such as output truncation and history compaction.
arXiv Machine Learning
Sep 11
The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
The paper discusses recursive self‑improvement (RSI) for AI, describing how systems can use experience and feedback to make lasting enhancements to both their abilities and their future improvement processes. It introduces the Headroom‑Closed Index (HCI) to expose limitations in current large language models and outlines a development roadmap for RSI, progressing from autonomy in execution to full recursive meta‑improvement. The authors analyze RSI in various contexts such as scientific discovery, embodied intelligence, and software engineering, noting differing requirements and development speeds, and they connect RSI research to practical industry applications while highlighting key challenges to achieving genuine RSI.
arXiv AI
Oct 15
Harness^2: Recursive Agent Harnessing for an Open World
arXiv:2610.14224v1 Announce Type: new Abstract: LLM agents' capabilities depend not only on their underlying models but also on their execution harnesses. Recursive self-improvement (RSI) offers a pr...
arXiv AI
Oct 21
MaD-RSI: Model-as-Data for Recursive Self-Improvement of Agent Harnesses
arXiv:2610.28201v1 Announce Type: new Abstract: Recursive self-improvement (RSI) of agent harnesses has emerged as an effective approach to enhancing the capabilities of large language model (LLM) ag...
arXiv AI
Jun 26
The Red Queen G\"odel Machine: Co-Evolving Agents and Their Evaluators
arXiv:2606. 26294v1 Announce Type: cross Abstract: Self-improving agents are state-of-the-art (SOTA) on agentic coding benchmarks and have recently been extended to general domains.