arXiv AI
AReaL-RSI: Adaptive Scaling and Coordination of Recursive Self-Improvement
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
Oct 15
Scaling Discovery Requires Forgetting
arXiv:2610.20563v1 Announce Type: cross Abstract: Automated research with LLM agents has shown promising results in various domains. Through iterative refinement and scored verifiers, LLM agents are...
arXiv Machine Learning
Oct 8
RSIGym: A Flexible Environment for Recursive Self-Improvement
RSIGym is a new agent-native research environment built on Everything as a Service (EaaS) that exposes training, inference, rollout, evaluation, and sandbox execution through reusable services. It supports shared budget and permission controls for Data, Harness, and Joint improvement tracks, allowing agents to investigate individual interventions and jointly optimize data, training settings, and execution harnesses within the same environment. Using RSIGym, the Opus 5 model achieved the highest RSI-Index of 0.4809 across five benchmarks, improving performance on software engineering, terminal interaction, mathematics, scientific reasoning, and skill-based tasks.
arXiv Computation and Language
Oct 22
Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures
The paper proposes a framework for building autonomous AI research teams that can discover linear attention architectures. By assembling agents with diverse disciplinary expertise, private research histories, shared experimental evidence, and adaptive allocation of research opportunities, the team can balance exploration and exploitation under limited experimental budgets. Experiments show that this design outperforms GDN2 at 1.3B scale on language modeling, common‑sense reasoning, and retrieval tasks, and that removing any single component weakens discovery.
Hugging Face Trending Papers
Oct 5
Evolving in Thought Space: Training a Small Model at Test Time Unlocks Better Discoveries
The paper introduces Guidance‑TTT, a method that separates strategic planning from execution in test‑time training for large language models. A small guidance model is trained at test time to propose high‑level changes, while a frozen, larger execution model implements these changes, reducing the cost of maintaining gradients and optimizer states. Guidance‑TTT achieves strong results across four domains—combinatorial optimization, heuristic programming, machine learning, and GPU kernel optimization—outperforming prior work and matching state‑of‑the‑art leaderboard scores.
arXiv AI
Oct 1
RSI-Master: Structuring Experiments to Guide Autonomous Model Improvement
arXiv:2609.35561v2 Announce Type: replace Abstract: Recursive self-improvement (RSI) seeks to enable AI systems to participate in improving their own capabilities. A concrete pathway is autonomous mo...
arXiv Machine Learning
Sep 23
Recursive self-improvement of AI research agents
The paper introduces AIDE^2, an AI research agent that recursively improves its own code by proposing, benchmarking, and selecting modifications. Over an eight‑day autonomous run, it achieved seven successive improvements—including new search policies and memory mechanisms—that transferred to four held‑out benchmarks in machine learning, algorithm engineering, and weather forecasting. The agent’s best version matched or outperformed a top human‑engineered production research agent and also reduced reward‑hacking rates, despite never optimizing for that metric.