arXiv AI

EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignment

EvoSteer introduces an online self‑evolving graph orchestration framework that continuously builds and repairs a team of tool‑using agents during execution. It employs Anchored Trajectory Balance (AnchorTB), a regression‑style loss that assigns credit to each orchestration action by comparing subtrajectories to a frozen reference, and Validated Skill Admission, which tests candidate skills before promotion. Experiments on twelve datasets demonstrate that EvoSteer outperforms existing baselines in question answering, mathematical reasoning, code generation, and interactive decision making.

arXiv AI
Oct 1

CollabFlow: Recursive Self-Improvement of Agent Collaboration

CollabFlow introduces a recursive self‑improvement framework for multi‑agent collaboration in large language model systems. It trains a Collab‑Director to assemble teams of agents, uses a frozen executor to run them, and retrains the director each round based on outcomes. The system incorporates evidence‑conditioned communication protocols within collaboration graphs and a Collaborative Trajectory Balance objective to maintain diverse high‑performing teams across rounds, achieving superior performance on twelve datasets.

By Xiao Huang, Mingda Zhang, Junming Zhang, Qiang Huang, Hanwen Zhang, Yue Dai, Zijia Wang, Xiaoying Tang
arXiv AI
Sep 2

HarnessEvolve: Learning from Reference Trajectories for Reliable Agent Self-Evolution

HarnessEvolve is a self‑evolving framework that improves agent harnesses—prompts, skills, tools, and execution logic—by learning from reference trajectories. It separates execution, evaluation, optimization, and gating into independent modules, addressing credit assignment failure, shortcut learning, and catastrophic forgetting. The approach uses reference trajectories to extract error signals, applies quality and performance gates to candidate updates, and validates updates on held‑out data, consistently outperforming state‑of‑the‑art baselines across diverse benchmarks.

By Wen Jiang, Mingmin Chu, Yimeng Tian, Qianxin Zhang, Haofei Yang, Rui Yang, Yang Liu, Tao Lv, Fangming Li
arXiv AI
Oct 19

R$^2$ Flow: Recursive Self-Improvement via Recursive Skill Evolution

R$^2$ Flow is a recursive self‑improvement framework for large‑language‑model agents that alternates policy learning, independent verification, and versioned skill‑library updates on a shared‑state orchestration graph. By merging histories that differ only in the order of independent steps, it pools evidence across equivalent executions and uses flow‑share readouts, signed utility ranks, verifier evidence, and residual‑variance plateaus to decide when and which skills to edit. Experiments on question answering, mathematical reasoning, interactive decision making, and code generation show that R$^2$ Flow improves task accuracy and library‑edit precision compared to heuristic orchestration, reinforcement learning, and other skill‑evolution baselines, and it transfers across different executors.

By Mingda Zhang, Qiang Huang, Yanjin Li, Zijia Wang, Qika Lin, Xiaoying Tang, Tiesunlong Shen
arXiv AI
Oct 31

MAS-Loop: Beyond One-Shot Orchestration towards Self-Evolving Multi-Agent Systems

MAS-Loop introduces an execution‑grounded framework that couples an Orchestrator with a trajectory‑conditioned Refiner to close the feedback loop in training‑time multi‑agent system design. For each task, the Orchestrator builds and runs a source MAS, then the Refiner uses the resulting trajectory to locate failures, diagnose them, and propose bounded patches to agents or execution settings. The updated MAS is re‑executed, and the pairwise comparison of outcomes provides learning signals that enable both components to co‑evolve, yielding stronger systems and a new dataset, MAS‑JudgeCorpus, for trajectory‑aware MAS research.

By Hehai Lin, Qi Yang, Chengwei Qin
arXiv AI
Oct 2

It Takes Workflows to Evolve Better Workflows

The paper "It Takes Workflows to Evolve Better Workflows" introduces FloWright, a method that uses a hierarchical, structure‑aware reward system to allow one or more roles in a multi‑agent workflow to self‑evolve without extra models or data. It also proposes DataWright, an adaptive data hardening technique that transforms existing datasets into more challenging workflow‑level tasks. Experiments on document, slide, chart, code, math, and finance tasks show that small open models trained with FloWright can improve performance by up to +7.41%, with co‑evolving multiple roles yielding the largest gains. "whyItMatters":"The work demonstrates that optimizing beyond the workflow generator—by enabling multiple agents to co‑evolve—can substantially enhance the effectiveness of multi‑agent workflows for complex real‑world tasks."

By Xuehang Guo, Haoyu Wang, Haifeng Chen, Yangyi Chen, Zhenhailong Wang, Qingyun Wang
arXiv Computation and Language
Oct 12

Proactive Agentic Orchestration

The paper introduces POrchestra, a proactive agentic orchestration framework that lets sub‑agents request harness adjustments during execution, enhancing adaptability to dynamic environments. It also proposes On‑Policy Orchestration Distillation (OPOD), which uses hindsight feedback from sub‑agents’ requests to provide targeted improvement signals for training the orchestration policy. Experiments on three long‑horizon benchmarks show that POrchestra boosts task success by about 9.1% over the best baseline, and with OPOD the improvement rises to 10.0%, while also improving cost‑performance trade‑offs.

By Xueyang Feng, Chaozhuo Li, Xiaohe Bo, Jiakai Tang, Chenxi Li, Qiwei Ye, Xu Chen
arXiv Computer Vision
Aug 28

OS-Marathon: Benchmarking Computer-Use Agents on Vast-Horizon, Repetitive Tasks

OS-Marathon is a new benchmark that tests computer‑use agents on vast‑horizon, repetitive tasks, covering 100 tasks across five scenarios and ten domains. The study shows that current state‑of‑the‑art agents perform poorly on these tasks, and that simply decomposing workflows into subtasks does not solve the problem. Introducing a cost‑friendly personalization method called GraphDemo, which adapts agents from a single human demonstration, improves performance, highlighting the value of human guidance for these challenging tasks.

By Jing Wu, Wenjie Ai, Daphne Barretto, Yiye Chen, Qingyu Chen, Yuhang He, Pranit Chawla, Nicholas Gyd\'e, Yanan Jian, Vibhav Vineet