arXiv Machine Learning
Sep 23

Recursive self-improvement of AI research agents

The paper introduces AIDE^2, an AI research agent that recursively improves its own code by proposing, benchmarking, and selecting modifications. Over an eight‑day autonomous run, it achieved seven successive improvements—including new search policies and memory mechanisms—that transferred to four held‑out benchmarks in machine learning, algorithm engineering, and weather forecasting. The agent’s best version matched or outperformed a top human‑engineered production research agent and also reduced reward‑hacking rates, despite never optimizing for that metric.

By Dhruv Srikanth, Bingchen Zhao, Dixing Xu, Yuxiang Wu, Zhengyao Jiang
arXiv Machine Learning
1d ago

Organon : From Evolutionary Search to Recursive Self-Improving Agents for Scientific Discovery

Organon is a recursively self‑improving agent designed for scientific discovery that autonomously revises its search strategies, population management, diagnostics, memory, and worker coordination during execution. By diagnosing and correcting its own adaptation procedures, the agent continuously refines the mechanisms guiding its future self‑improvement. Across 21 computational discovery tasks—including algorithm design, GPU kernel optimization, and systems optimization—Organon outperforms competing frameworks, achieving a 20.5% mean performance gain on ALE‑Bench Lite and up to 1.67× speedups on KernelBench.

By Cheikh Ahmed, Zhiyu Zhang, Kun Mao, Yong Zhang, Zirui Zhou