arXiv:2610.34043v1 Announce Type: cross Abstract: Autonomous agents are increasingly deployed across sequences of related tasks, yet they often fail to retain and improve their knowledge over time. E...
The paper introduces RIKA, a method for reliable knowledge acquisition in continual learning agents. RIKA hierarchically extracts factual, conceptual, procedural, and metacognitive knowledge and uses evidence-based admission to decide which claims are incorporated into the agent’s context, avoiding the reuse of unreliable information. Experiments on six task streams and four model backbones show that RIKA outperforms existing memory and experience-learning systems on aggregate performance.
arXiv:2609.23989v1 Announce Type: new Abstract: Building general-purpose agents for industrial deployment requires integrating multiple capabilities, each typically acquired at a distinct stage of tr...
Learn2Play Bench is a new benchmark that tests how well large language model agents learn from experience in unfamiliar, text‑based games with novel or counterintuitive rules. The benchmark provides reproducible feedback, automatic scoring, and varied game instances to evaluate learning across repeated attempts and transfer to new situations. Findings show that retaining full action records aids learning, human players outperform agents, and the choice of harness significantly impacts performance and inference cost.
WikiSkill is a framework that separates raw execution experience, accumulated knowledge, and executable skills, continuously consolidating experience into a persistent knowledge base (wiki). By co‑evolving agent skills with this wiki, the method consistently outperforms state‑of‑the‑art skill‑evolution techniques across diverse benchmarks and models. The study shows that larger models benefit more from evolved skills, smaller models can outperform larger ones when equipped with skills, and that skills transfer effectively across model families, with the wiki’s persistent knowledge being critical for success.
arXiv:2605.08693v3 Announce Type: replace Abstract: Skills provide an effective mechanism for improving LLM agents on complex tasks, yet in existing agent frameworks, their creation, refinement, and...
arXiv:2609.05435v2 Announce Type: replace Abstract: Can language agents continually learn from experience, turning earlier interactions into reusable capabilities? AhaBench evaluates this ability thr...
Large language model (LLM) agents are trained with reinforcement learning (RL) for complex decision-making tasks. However, most RL-trained agents remain episodic and cannot accumulate reusable knowled...
arXiv:2608. 03874v1 Announce Type: new Abstract: Modern agent frameworks equip large language models with external skill libraries to solve complex tasks.
Modern agent frameworks equip large language models with external skill libraries to solve complex tasks. However, it remains unclear whether these systems can effectively evolve their skills and whether the resulting skills improve task-solving capabilities.
The paper introduces the Continual Learning Exam (CLE), a benchmark designed to evaluate how large language model (LLM) agents improve over time by learning from experience. CLE consists of 120 human-authored tasks organized into five-level ladders, totaling 600 levels across 89 professional roles in 12 domains, where agents must pass each level to unlock the next. Experiments with 17 frontier LLM configurations show that providing diagnostic feedback and allowing one revision improves median completion by 5.3 percentage points, yet the best system only clears 47.7% of levels and completes all five levels in 23.3% of tasks, underscoring the challenge of sustained learning from experience.
The paper introduces Self‑Direction, a method that lets agents learn from mistakes by reflecting on failed trajectories, distilling lessons into lightweight low‑rank adapters, and storing them for future use. These adapters add only about 0.02% of the base model’s parameters, keeping the original weights frozen and avoiding costly fine‑tuning. Experiments on Qwen‑based agents across research, tool‑use, and terminal tasks show 8.9–17.0 percentage‑point gains in success rates, reduced repeated errors, and transfer of lessons to new tasks.