arXiv AI By Yang Xiao, Yusong Sun, Haoyi Wu, Wenyang Hui, Wen Da, Zhaokai Luo, Mu Chuan, Yao Hu, Wenjie Li, Chengyue Jiang

PILOT in the Loop: Live Self-Improvement for Long-Horizon Agents

Read the original on arXiv AI →

PILOT introduces a live self‑improvement framework for long‑horizon agents, enabling a supervisor to redirect or abort an active worker during execution and to distil learned procedures into reusable skills. Unlike existing single‑agent or subagent architectures, PILOT’s supervisor‑worker harness supports real‑time steering and self‑evolution. Experiments on two frozen backbones across three benchmarks show PILOT outperforming other harnesses, achieving significant gains in performance metrics and efficiency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
3d ago

Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer

The paper introduces a self‑evolving harness framework where a frozen language‑model agent first solves tasks and then edits its own harness based on run records. Using a 49‑line seed harness, the evolved harness improves average scores on in‑distribution benchmarks by 4.48 points and on out‑of‑distribution benchmarks by 12.64 points, surpassing Codex on the former and matching it on the latter. Continued evolution on a specific out‑of‑distribution benchmark further raises performance, and the study analyzes emergent mechanisms such as output truncation and history compaction.

By Qiankai Xu
arXiv Computation and Language
Sep 14

EvoHarnessBench: Can Your Agents Keep Pace with an Evolving Harness?

arXiv:2609.04280v2 Announce Type: replace-cross Abstract: Modern LLM-based agents operate through a harness of tools, reusable skills, and specialist agents that shapes what they observe and what the...

By Zixuan Ke, Vaidehi Patil, Haizhou Shi, Yang Li, Ye Liu, Sarath Shekkizhar, Anurag Koul, Jiayu Wang, Xuan Phi Nguyen, Semih Yavuz, Mohit Bansal, Shafiq Joty