arXiv AI By Illia Dovhoshliubnyi, Nima Soroush, Ashkan Sami, Alexander Brownlee

What Do AI Agents Actually Change? An Empirical Taxonomy of Mutation Patterns in Performance-Improving Pull Requests

Read the original on arXiv AI →

arXiv:2607. 05666v1 Announce Type: cross Abstract: AI coding agents are black boxes: we cannot inspect how they generate code, but we can inspect what they change.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jul 10

TTHE: Test-Time Harness Evolution

arXiv:2607. 08124v1 Announce Type: cross Abstract: The behavior of an LLM agent is determined not only by the underlying model, but also by its harness: the executable program that constructs context, invokes tools, verifies intermediate results, and recovers from failures.

By Jun Nie, Yonggang Zhang, Jun Song, Qianshu Cai, Dahai Yu, Yike Guo, Xinmei Tian, Bo Han
arXiv AI
Oct 12

Meta-Reflective Evolution Effectively Improves Production AI Systems

Meta-Reflective Evolution Effectively Improves Production AI Systems describes CoCoEvolve, an evolutionary optimizer that uses meta-reflection to retrieve evidence from the entire evolutionary history and probe live systems before proposing mutations. The approach is applied to data agents, LLM-powered data pipelines, and data engineering workflows, achieving state‑of‑the‑art results on DABStep, multiple LLM pipeline workloads, and data-eng-bench. Ablation studies confirm that each component of CoCoEvolve contributes to its performance gains.

By Seung Won Wilson Yoo, Chang Zeng, Aditi Somayajula, Sahithi Ankireddy, Rohan Kosalge, Avishree Khare, John Mitchell, Aditya G. Parameswaran, Rajhans Samdani, Anupam Datta
arXiv AI
Oct 28

The View from Nowhere: Population-Centered Agent Evolution

The paper introduces Population-Centered Evolution (PCE), a new principle for improving self‑improving AI agents by leveraging patterns of success, failure, and prior modifications across the entire population rather than focusing solely on selected parent agents. PCE distills task records and modification histories into a population block that guides enhancements to a chosen parent’s harness. Experiments show that PCE raises success rates on SWE‑bench Verified and Polyglot benchmarks, narrowing the gap between population coverage and best‑agent performance.

By Shuo Yan, Ningning Hou, Haoyu He, Haochen Pei, Shang Gao
arXiv AI
Aug 18

Evolving Ensemble of Agents

arXiv:2605. 09018v4 Announce Type: replace-cross Abstract: We introduce the Evolving Ensemble of Agents (EvE), a decentralized framework that organizes existing, highly capable coding agents into a live, co-evolving system for algorithmic discovery.

By Zongmin Yu, Liu Yang