The paper introduces MemCryst, a framework that enables lifelong learning for large language model agents by jointly adapting memory and skills while keeping the language model frozen. MemCryst stores recurring episodes in memory to support skill creation and revision, and uses the resulting skills to guide future interactions, which in turn generate new memory. Experiments across ten diverse settings—including embodied control, long-document reading, conversation, mathematics, and code—show that MemCryst outperforms memory-only and skill-only baselines, achieving 63.17% success on ALFWorld.
arXiv:2606. 02461v2 Announce Type: replace Abstract: Language agents spend substantial inference time solving individual tasks, yet the experience acquired in one episode is often underutilized in future episodes.
arXiv:2606. 02461v1 Announce Type: new Abstract: Language agents spend substantial inference time solving individual tasks, yet the experience acquired in one episode is often underutilized in future episodes.
Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks. Yet nearly all existing approaches, from graph-structured memories to reflective insight stores, access memory through fixed, hand-designed heuristics.
Modern agent frameworks equip large language models with external skill libraries to solve complex tasks. However, it remains unclear whether these systems can effectively evolve their skills and whether the resulting skills improve task-solving capabilities.
arXiv:2608. 03874v1 Announce Type: new Abstract: Modern agent frameworks equip large language models with external skill libraries to solve complex tasks.
The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.
arXiv:2607. 13591v1 Announce Type: cross Abstract: Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks.
Memorilla is a memory system that encodes an entire document collection into reusable embeddings and retrieves query‑specific information as a fixed set of memory tokens for a frozen large language model. Using only 16 memory tokens, it outperforms baselines such as Mem0 and MemoRAG on most benchmarks, achieving higher accuracy on FactKG while drastically reducing token usage. In agentic settings, Memorilla helps prevent wandering and boosts success rates in a TextWorld environment, demonstrating its utility for continual learning and long‑context interactions.
arXiv:2609.36435v1 Announce Type: new Abstract: An assistant that serves the same user over a long horizon has to answer from what that user has revealed: which preferences still hold, which were rev...
arXiv:2608. 02515v1 Announce Type: cross Abstract: Long-running assistants and agents consume interaction streams that eventually outgrow the context.
The paper introduces TokenWorth, a lightweight framework that learns the value of past experiences for self-improving agents operating under strict resource constraints. By using sparse execution feedback, TokenWorth guides both retrieval and memory management without updating the core model, enabling agents to adaptively reuse only the most beneficial experiences. Experiments on LifelongAgentBench show that TokenWorth outperforms existing lifelong-memory methods in task success while minimizing output tokens within the given budgets.
The paper introduces REM (Reusable Experience Memory), a framework that manages the lifecycle of experience for large language model agents performing long-horizon coding tasks. REM consolidates completed trajectories into compact, phase-structured documents, injects them at task start, and evicts them after a single exposure, making the memory system responsive to the agent’s needs. Experiments on repository-level bug fixing show REM outperforms state‑of‑the‑art memory systems in retrieval accuracy and task resolution while reducing cost.