The paper investigates whether scaling artificial general intelligence (AGI) can be achieved more efficiently by co‑designing a lightweight, semantically aware predictor (System‑1) with a resource‑intensive executive (System‑2). It introduces a conditional interaction loop—predict, gate, execute, update—where System‑1 estimates the utility of candidate actions and only allows System‑2 to execute those that meet an adaptive threshold. The authors show that, under ideal conditions, this approach can reduce execution compute by a factor related to the density of utility‑relevant interactions, and they argue that this density (ρu) is a measurable coordinate of scaling efficiency, making informative compute a better metric than total compute.
By Qi Wang, Yun Qu, Lizhou Cai, Heming Zou, Haoang Chi, Yiqin Lv, Xiang Li, Haiyan Feng, Mengyu Ge, Yize Geng, Yuhang Jiang, Yixiu Mao, Xiangyang Ji
arXiv:2609.14500v1 Announce Type: new
Abstract: AI scaling studies increasingly evaluate systems that combine a pretrained model with retrieval, search, verification, tools, and interaction. Yet a hi...
By Seyed Morteza Emadi
arXiv:2607. 06764v1 Announce Type: new Abstract: Recent progress on ARC-AGI-1 from disclosed architectures has come broadly from two regimes: heavy test-time compute over frontier models (evolutionary search, exhaustive sampling, extended chain-of-thought), or benchmark-specific training in which small models are fine-tuned on ARC data, often with task-specialized architectures.
By Kabir Moghe, Peter Chin
arXiv:2607. 14408v1 Announce Type: new Abstract: A self-evolving agentic loop repeatedly proposes a tweaked version of an agent (its prompt template or program) and accepts or rejects the change based on a per-iteration quality signal.
By Minghao Liu, Yu Wang, Jiayun Wang, Wei Wei
arXiv:2606. 01667v1 Announce Type: new Abstract: Test-time scaling has become a major way to improve large language model reasoning, but its orchestration has remained designer-engineered: a fixed sample budget, a fixed refinement loop, a fixed scoring rule, or a fixed search policy decides how compute is spent, leaving the model in charge of solving but not of orchestration.
By Peijia Qin, Qi Cao, Pengtao Xie
The paper investigates how data should be scaled in agentic reinforcement learning, where data is now a structured design space of tasks, environments, and trajectories. By fitting per‑axis scaling laws across various large language models and RL algorithms, the authors find that environment diversity has the strongest impact, followed by task and trajectory diversity. Using these laws, they price synthesis methods, identify critical synthetic‑to‑real ratios, and formulate a compute‑optimal budget allocation that can improve efficiency by up to 1.7× compared to the common practice of scaling trajectories alone.
By Bowei He, Yankai Chen, Xiaokun Zhang, Changjiang Han, Ye Yuan, Chong Li, Xue Liu
The paper introduces Guidance‑TTT, a method that separates strategic planning from execution in test‑time training for large language models. A small guidance model is trained at test time to propose high‑level changes, while a frozen, larger execution model implements these changes, reducing the cost of maintaining gradients and optimizer states. Guidance‑TTT achieves strong results across four domains—combinatorial optimization, heuristic programming, machine learning, and GPU kernel optimization—outperforming prior work and matching state‑of‑the‑art leaderboard scores.
The paper introduces Evolutionary System Prompt Learning (E‑SPL), a method that jointly updates a large language model’s weights via reinforcement learning and its system prompts via self‑reflection. In each RL iteration, E‑SPL samples trajectories under multiple prompts in parallel, using them to both evolve the prompts and improve the model’s weights. Experiments show that E‑SPL boosts success rates across several benchmarks (e.g., from 38.8 % to 45.1 % on AIME → BeyondAIME) and outperforms RL‑only or evolution‑only baselines, indicating that weight and context updates synergistically enhance generalization.
By Lunjun Zhang, Ryan Chen, Bradly C. Stadie
arXiv:2608. 06714v1 Announce Type: new Abstract: Recent systems for optimizing prompts, programs, and ML workflows typically rely on explicit outer-loop controllers such as evolutionary search, bandits, or textual-gradient methods.
By Junbo Li, Boyi Liu, Canwen Xu, Yite Wang, Yuxiong He, Zhangyang Wang, Qiang Liu, Zhewei Yao
The paper investigates how optimizing the harness of language model agents—without changing model weights—affects performance. It distinguishes between gains that improve success on tasks already within reach (elicitation) and gains that broaden the range of solvable tasks (expansion). By comparing optimized harnesses to their pre‑optimization versions across static and dynamic tasks, the study finds that benefits can reverse at higher attempt budgets and that aggregate gains may mask shortcomings on harder tasks, highlighting the need for detailed diagnostics.
By Younghyun Kim, Wooseok Seo, Minseo Kim, Seunghyuk Oh, Minjae Lee, Donghoon Kim, Hyung Il Koo, Jaehyung Kim, Wonjun Kang
RSI-Opt introduces Recursive Self-Improvement Optimizer Agents that evolve their own training policies by accumulating knowledge from previous runs, including prompts, playbooks, optimizer code, and decision cadences. A meta‑agent rewrites and archives these policies, enabling reusable procedures and code that adapt to new tasks. Across multiple generations and tasks, RSI‑Opt improves optimizer performance, achieving higher z‑scores on evolution suites, better cross‑model transfer, and significant error reductions on PDE benchmarks compared to fixed‑prompt baselines.
By Binghang Lu, Yige Sun, Guang Lin
arXiv:2608. 09629v1 Announce Type: new Abstract: Self-evolving agents are usually built around prescribed optimization pipelines: the framework decides how to gather evidence, revise a persistent artifact, select candidates, and stop.
By Hui Xue, Fan Yang