Self-improving AI systems can revise the designs that govern their own behavior. Yet existing approaches center improvement on selected parent agents and their evolutionary experience, leaving the bro...
The paper introduces Agent S4, an autonomous system that learns to design and refine user interfaces for computer‑use agents by observing task execution without explicit success labels. By evolving a repository of interfaces through population‑based selection on unseen validation tasks, Agent S4 achieves state‑of‑the‑art performance on OSWorld V2 and significant gains on ScienceBoard, outperforming large commercial models at lower cost. The work demonstrates that interface design can be treated as an agent capability, enabling continuous improvement beyond fixed, hand‑crafted interfaces.
By Saaket Agashe, Yuzhe Yang, Gonzalo Gonzalez-Pumariega, Bhuvan Chandra Koduru, Chih-Lun Li, Jiachen Yang, Ang Li, Xin Eric Wang
arXiv:2610.29784v1 Announce Type: new
Abstract: Most contemporary artificial intelligence (AI) systems are released with frozen parameters and improve through external updates, whereas an ideal syste...
By Zhipeng Chen, Yunsen Liang, Yanxi Chen, Hongkang Zhao, Lingyun Feng, Ruiyang Ren, Guoxin Chen, Jia Deng, Feng Chang, Chuan Hao, Ran Tao, Jian Yang, Ji-Rong Wen, Bryan Dai, Wayne Xin Zhao
arXiv:2606. 26294v1 Announce Type: cross Abstract: Self-improving agents are state-of-the-art (SOTA) on agentic coding benchmarks and have recently been extended to general domains.
By Alex Iacob, Andrej Jovanovi\'c, William F. Shen, Daniel Burkhardt, Meghdad Kurmanji, Nurbek Tastan, Lorenzo Sani, Niccol\`o Alberto Elia Venanzi, Ambroise Odonnat, Zeyu Cao, Bill Marino, Xinchi Qiu, Nicholas D. Lane
FREEEVOLVE automates the optimization loop used by agent evolvers, allowing the system to decide what to test, how much evidence to gather, which candidates to pursue, and when to stop, all within specified resource limits. By treating these decisions as an editable evolution skill and improving them through meta‑evolution, the method learns a capability that replaces hand‑crafted search loops. Experiments on several benchmarks show that FREEEVOLVE improves primary metrics by an average of 13.6 points and that meta‑evolved skills add further gains, indicating transferability across environments.
By Lecheng Kong, Like Hui, Nikos Kanakaris, Prithwish Jana, Sahika Genc, Narayanan Sadagopan
arXiv:2608. 07545v1 Announce Type: cross Abstract: An LLM agent's capability depends not only on model weights but on its harness: prompts, tools, skills, and control flow.
By Yifan Zhang, Yutong Dai, Juntao Tan, Luyu Yang, Rishi Mullur, Thai Hoang, Zhiyuan Hu, James Zhu, Phil Mui, Silvio Savarese, Ran Xu, Zeyuan Chen
The paper introduces Successive Scale Racing (SSR), a framework that improves agentic harness evolution by adaptively selecting optimal evidence combinations during each evolution round. SSR constructs diverse evidence sets based on task quality and coverage, then efficiently races candidate harnesses under a limited compute budget. Across three benchmarks, SSR outperforms baselines, steadily raising pass rates as the task pool expands from 40 to 200 while cutting validation executions by 60%.
By Jingzhe Liu, Jiliang Tang, Tong Zhao, Neil Shah, Clark Mingxuan Ju
arXiv:2608. 09629v1 Announce Type: new Abstract: Self-evolving agents are usually built around prescribed optimization pipelines: the framework decides how to gather evidence, revise a persistent artifact, select candidates, and stop.
By Hui Xue, Fan Yang
arXiv:2610.36826v1 Announce Type: new
Abstract: Autonomous agents increasingly depend on harnesses that govern interaction, memory, tools, and execution around large language models (LLMs). While rec...
By Hao Chen, Yukun Yan, Ziyu Han, Ye He, Chuanzhe Guo, Shangzhan Li, Qi Shi, Qingfu Zhu, Maosong Sun, Wanxiang Che
arXiv:2609.35290v2 Announce Type: replace
Abstract: Recent work has explored improving agents by jointly evolving their harnesses and models, but often takes a ''potpourri'' approach that bundles tog...
By Shihan Dou, Shaofan Liu, Zhonghang Lu, Jiahang Lin, Shichun Liu, Binghai Wang, Jiajie Jin, Guanting Dong, Tao Gui, Qi Zhang, Xuanjing Huang
arXiv:2609.24663v1 Announce Type: new
Abstract: Self-evolving agents convert interaction feedback into persistent artifacts, such as memories or skills, which in turn guide subsequent decisions. As t...
By Hongqiang Lin, Chao Liu, Xiaofan Bai, Xuan Jin, Yuhong Li, Nenggan Zheng, Xipeng Cao
Meta-Reflective Evolution Effectively Improves Production AI Systems describes CoCoEvolve, an evolutionary optimizer that uses meta-reflection to retrieve evidence from the entire evolutionary history and probe live systems before proposing mutations. The approach is applied to data agents, LLM-powered data pipelines, and data engineering workflows, achieving state‑of‑the‑art results on DABStep, multiple LLM pipeline workloads, and data-eng-bench. Ablation studies confirm that each component of CoCoEvolve contributes to its performance gains.
By Seung Won Wilson Yoo, Chang Zeng, Aditi Somayajula, Sahithi Ankireddy, Rohan Kosalge, Avishree Khare, John Mitchell, Aditya G. Parameswaran, Rajhans Samdani, Anupam Datta