Autonomous agents are increasingly deployed across sequences of related tasks, yet they often fail to retain and improve their knowledge over time. Existing approaches convert interaction trajectories...
arXiv:2609.23989v1 Announce Type: new
Abstract: Building general-purpose agents for industrial deployment requires integrating multiple capabilities, each typically acquired at a distinct stage of tr...
By Haixin Wang, Xiaoxuan Wang, Junkai Zhang, Han Zhang, Renliang Sun, Alexander K Taylor, Yidan Shi, Haoran Deng, Chenguang Wang, Jason Cong, Yizhou Sun, Wei Wang
The paper introduces RIKA, a method for reliable knowledge acquisition in continual learning agents. RIKA hierarchically extracts factual, conceptual, procedural, and metacognitive knowledge and uses evidence-based admission to decide which claims are incorporated into the agent’s context, avoiding the reuse of unreliable information. Experiments on six task streams and four model backbones show that RIKA outperforms existing memory and experience-learning systems on aggregate performance.
By Yixu Huang, Jiaqi W. Ma
arXiv:2605.08693v3 Announce Type: replace
Abstract: Skills provide an effective mechanism for improving LLM agents on complex tasks, yet in existing agent frameworks, their creation, refinement, and...
By Min Yang, Jinghua Piao, Xu Xia, Xiaochong Lan, Jiaju Chen, Yongshun Gong, Yong Li
arXiv:2609.05435v2 Announce Type: replace
Abstract: Can language agents continually learn from experience, turning earlier interactions into reusable capabilities? AhaBench evaluates this ability thr...
By Zerui Cheng, Jiawei Xu, Huacan Chai, Jiayang Sun, Pramod Viswanath, Maxm Pan
Learn2Play Bench is a new benchmark that tests how well large language model agents learn from experience in unfamiliar, text‑based games with novel or counterintuitive rules. The benchmark provides reproducible feedback, automatic scoring, and varied game instances to evaluate learning across repeated attempts and transfer to new situations. Findings show that retaining full action records aids learning, human players outperform agents, and the choice of harness significantly impacts performance and inference cost.
By Yibo Li, Jinhang Qiu, Zhi Zheng, Qianyun Guo, Jiaying Wu, Shuo Ji, Bryan Hooi
WikiSkill is a framework that separates raw execution experience, accumulated knowledge, and executable skills, continuously consolidating experience into a persistent knowledge base (wiki). By co‑evolving agent skills with this wiki, the method consistently outperforms state‑of‑the‑art skill‑evolution techniques across diverse benchmarks and models. The study shows that larger models benefit more from evolved skills, smaller models can outperform larger ones when equipped with skills, and that skills transfer effectively across model families, with the wiki’s persistent knowledge being critical for success.
By Liyan Tang, Cyrus Rashtchian, Chun-Sung Ferng, Andrew Tomkins, Da-Cheng Juan, Tu Vu
The paper introduces Self‑Direction, a method that lets agents learn from mistakes by reflecting on failed trajectories, distilling lessons into lightweight low‑rank adapters, and storing them for future use. These adapters add only about 0.02% of the base model’s parameters, keeping the original weights frozen and avoiding costly fine‑tuning. Experiments on Qwen‑based agents across research, tool‑use, and terminal tasks show 8.9–17.0 percentage‑point gains in success rates, reduced repeated errors, and transfer of lessons to new tasks.
By Yuval Kansal, Karen Ullrich, Polina Kirichenko, Ilia Kulikov, Niraj K. Jha, Mohammad Pezeshki, Mark Ibrahim
arXiv:2608. 03874v1 Announce Type: new Abstract: Modern agent frameworks equip large language models with external skill libraries to solve complex tasks.
By Tianyi Guan, Yiding Wang, Haotong Yang, Siyuan Cao, Shirui Liu, Yi Hu, Jiaqi Li, Muhan Zhang
Large language model (LLM) agents are trained with reinforcement learning (RL) for complex decision-making tasks. However, most RL-trained agents remain episodic and cannot accumulate reusable knowled...
The paper introduces Boundary-Aware Skill Memory (BASM), a method that enriches skill memories for large language model agents with explicit boundary fields such as applicability conditions, risk cues, avoidance rules, and recovery notes. This approach transforms retrieved skills from unconditional templates into state‑conditioned guidance, preventing the Skill Imitation Trap where more skills lead to incorrect tool usage. Experiments on three agent benchmarks and four model scales show that BASM improves task success rates, accuracy, and reduces attack success while cutting average steps compared to memory‑free baselines.
By Zihan Lin, Zhenyu Chen, Jiawen Wei, Xiaohan Wang, Jie Cao, Jiajun Chai, Wei Lin, Guojun Yin, Ran He
arXiv:2608. 15165v1 Announce Type: new Abstract: Large language model (LLM) agents can continually improve without parameter updates by converting historical experience into reusable procedural knowledge.
By Yu He, Weikai Yang