arXiv Computation and Language By Zihao Deng, Yining Zhu, Leiming Wang, Junbo Wang, Jingfei Lu

Tree-of-Experience: Hierarchical Experience Management for Self-Evolving Agents

Read the original on arXiv Computation and Language →

Tree-of-Experience (ToE) is a hierarchical experience-management framework designed for large language model agents that aligns stored experiences with the agents’ reasoning hierarchy. By organizing experiences into a shared tree of analytical perspectives and reasoning paths, ToE calibrates reliability through environmental outcomes, enabling systematic updating, cross-task transfer, and efficient retrieval. Experiments on Game of 24 and FinEvolveBench demonstrate that ToE yields significant performance gains—31.4% accuracy improvement on Game of 24 and a 41.24% average improvement in tsIC on FinEvolveBench—outperforming both experience-free baselines and conventional experience-management methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Oct 19

Darwin-Claw: Environment-Adaptive Experience Consolidation for Recursively Self-Evolving Agents

Darwin‑Claw is a new framework for large language model agents that enables environment‑adaptive, self‑evolving behavior. It systematically distills episodic experiences into prototype vectors through a hierarchical experience consolidation system, providing context‑sensitive perception patches and explicit optimization signals for skill refinement. The method is deployable with mainstream agent systems and, according to experiments on WildClawBench, delivers significant performance gains while maintaining controllability and stability.

By Mingze Yin, Xiaohan Wang, Dian Li, Longfei Luo, Jiahong Yan, Yiheng Zhu, Chang-Yu Hsieh
arXiv AI
1d ago

Towards Robust Long-Lived Agents: Benchmarking Experience Lifecycles in Evolving Environments

The paper introduces ReScopeBench, a benchmark designed to evaluate how agents manage the lifecycle of experience in evolving environments. It differentiates between structural experience—knowledge about how an environment is organized—and rule experience—principles that guide decisions across tasks. Using an experience-first construction approach, the study tracks how agents acquire, reuse, and revise experience across task streams, revealing that while retained experience boosts performance, agents often fail to keep it current when environments change.

By Shijue Huang, Hangyu Guo, Hengheng Zhang, Guo An, Zhitao He, Qi Tian, Yiren Feng
arXiv AI
Sep 10

Procedural Graphs: Self-Evolving Execution Structures for LLM Agents

The paper introduces Procedural Graphs, a framework that structures procedural knowledge for large language model agents as (procedure, relation, procedure) triplets, analogous to knowledge graphs for factual data. At each decision point, a guidance model uses the local subgraph to bias the agent’s next action, while an LLM refiner self‑evolves the graph by comparing failed and successful trajectories, editing its topology to improve performance. Experiments across various datasets, tasks, and LLMs show that Procedural Graphs consistently outperform memory‑based baselines, and the self‑evolution mechanism further enhances results without manual engineering.

By Yuxing Lu, Yicheng Chen, Shanchan Wu, Sercan \"{O}. Ar{\i}k
arXiv AI
Oct 16

MetaExp: Learning to Self-Improve through Experience via Verifiable Cross-Task Environment Scaling

MetaExp is a framework that trains language‑model agents to learn reusable experience across tasks by using verifiable cross‑task environment scaling. It introduces two designs—Shared‑Tool families that keep black‑box tools constant and Shared‑Workflow families that preserve latent procedures—allowing agents to acquire operational and procedural experience respectively. After fine‑tuning Qwen3.5‑122B‑A10B on thousands of trajectories from 1,000 task families, MetaExp achieves significant performance gains on benchmarks such as SpreadsheetBench, APEX‑Agents, and AutomationBench, with improvements persisting even when domain‑excluded training is applied.

By Renhao Li, Xinjie Shen, Yang Su, Jianhong Tu, Derek F. Wong, Dayiheng Liu, Min Yang
arXiv AI
Jul 7

EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer

arXiv:2607. 05202v1 Announce Type: new Abstract: Agent self-evolution in long-horizon LLM systems is largely procedural: useful experience is not merely stored information, but reusable procedures for searching, debugging, and verification.

By Xingze Gao, Chuanrui Hu, Hongda Chen, Pengfei Yao, Zhao Wang, Yi Bai, Zhengwei Wu, Yunyun Han, Xiaofeng Cong, Jie Gui, Yafeng Deng, Teng Li