arXiv Computation and Language

Self-Evolving Agents Can Repair Failures but Struggle to Generalize from Them

arXiv AI
Oct 19

Darwin-Claw: Environment-Adaptive Experience Consolidation for Recursively Self-Evolving Agents

Darwin‑Claw is a new framework for large language model agents that enables environment‑adaptive, self‑evolving behavior. It systematically distills episodic experiences into prototype vectors through a hierarchical experience consolidation system, providing context‑sensitive perception patches and explicit optimization signals for skill refinement. The method is deployable with mainstream agent systems and, according to experiments on WildClawBench, delivers significant performance gains while maintaining controllability and stability.

By Mingze Yin, Xiaohan Wang, Dian Li, Longfei Luo, Jiahong Yan, Yiheng Zhu, Chang-Yu Hsieh
arXiv AI
Oct 1

Rep2Skill: Representation-Guided Skill Self-Evolution for LLM Agents

Rep2Skill introduces a representation-guided framework that enables large language model agents to self-evolve their textual skills by analyzing internal representation trajectories from agent rollouts. The method identifies execution turns that deviate from successful dynamics and uses these signals, together with execution contexts, as actionable feedback for targeted skill revision. Experiments with two open-source LLMs across two agent environments demonstrate that Rep2Skill consistently outperforms purely text-based approaches, showing that incorporating internal representations can enhance agent self-improvement.

By Kaixing Zhang, Changming Li, Yingdong Shi, Zheng Zhang, Kaitao Song, Wenjie Shi, Jingang Wang, Kan Ren
arXiv AI
Sep 25

A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents

The paper introduces SkillPivot, a framework that guides large language model agents to evolve their skills by pinpointing the exact moment a useful problem‑solving sequence turns into an erroneous suffix. SkillPivot uses execution validity, goal progress, and action diversity to detect this deviation point, then employs a stronger teacher to generate a successful alternative from the same prefix. By contrasting the failed and successful suffixes, the method produces localized, compact skill updates that preserve existing effective guidance, outperforming other skill‑evolution techniques on benchmarks such as ToolQA, LogicBench, and WildClawBench.

By Yichun Feng, Jiawei Wang, Haozhe Sun
arXiv AI
Oct 1

Co-Evolving Agents: Learning from Failures as Hard Negatives

The paper introduces a co‑evolving framework where a target agent improves by learning from its own failures, and a separate failure agent is trained to generate hard negative trajectories. These hard negatives, derived from plausible but incorrect attempts, help the target agent better distinguish successful behavior from subtle errors. Experiments on online shopping, scientific reasoning, and interactive SQL querying show a 5.7% average reward improvement over baseline methods.

By Yeonsung Jung, Trilok Padhi, Sina Shaham, Dipika Khullar, Joonhyun Jeong, Ninareh Mehrabi, Eunho Yang
Hugging Face Trending Papers
Sep 24

A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents

The paper introduces SkillPivot, a framework that guides large language model agents to improve their natural-language skills by focusing on the point where a successful solution path deviates into an error. SkillPivot identifies this transition using execution validity, goal progress, and action diversity, then employs a stronger teacher to generate a successful alternative from the same prefix. By contrasting the failed and successful suffixes, the method produces localized, compact skill updates that preserve existing effective guidance and outperform other skill-evolution approaches on multiple benchmarks.

Hugging Face Trending Papers
Sep 28

SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

SEABench is a benchmark designed to study endogenous misalignment in self‑evolving large language model agents. It contains 48 longitudinal task sequences across various evolution surfaces, task domains, and harm types, and includes an adaptive trajectory discovery pipeline that probes for failures while preserving task intent. Evaluations show that self‑evolution improves task completion rates but often introduces safety failures absent in non‑evolving baselines, with divergent safety behaviors reflected in agents’ chain‑of‑thought reasoning that can be monitored to mitigate unsafe actions.

arXiv AI
Jul 31

Living-Harness Is an Interactive-Agent Evolver

arXiv:2607. 26598v1 Announce Type: cross Abstract: Large language model (LLM) agents may recover from a failure within an episode or after a retry, yet the same execution failure can recur in later tasks because post-episode feedback rarely revises the persistent harness that guides future interactions.

By Yuetian Du, Yucheng Wang, He Xu, Jiexu Xu, Shanwen Tan, Bing Zhao, Boyu Yang, Zhijie Xu, Ming Kong, Hu Wei, Jie Liu, Qiang Zhu
arXiv AI
2d ago

EvolveMAS: A Unified Self-Evolution Framework for Decentralized Multi-Agent Systems

arXiv:2610.34450v1 Announce Type: cross Abstract: Decentralized multi-agent systems (MAS) enable large language model agents to interact without centralized control. Agents need to adapt to other age...

By Yalun Wu, Qiwei Ma, Bingbing Xu, Dan Zhang, Long Bai, Boyang Wang, Jiatong Li, Zheqi Lv, Shaozu Yuan, Peiying Wang, Jiawei Wang, An Zhang, Tat-Seng Chua