arXiv AI
Aug 21
Can Agent Memory Systems Track Evolving State?
arXiv:2608. 19652v1 Announce Type: new Abstract: As LLM-based agents are deployed for longer and higher-stakes tasks, their memory systems continue to have crucial gaps.
Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning
The paper introduces the Unified Memory Agent (UMA), a system that builds a query‑agnostic external memory from a data stream and reuses it across multiple question‑answering sessions. UMA employs a single policy to manage a structured Memory Bank via CRUD operations and uses Task‑Stratified GRPO to supervise memory maintenance based on QA trajectory rewards. The authors also present Ledger‑QA, a benchmark for long‑horizon state tracking, and demonstrate that UMA outperforms other methods on test‑time learning and accurate‑retrieval tasks, with UMA‑Specialist further improving performance after task adaptation.
Related stories
arXiv AI
Jun 30
Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
arXiv:2507. 05257v4 Announce Type: replace-cross Abstract: Recent benchmarks for Large Language Model (LLM) agents primarily focus on evaluating reasoning, planning, and execution capabilities, while another critical component-memory, encompassing how agents memorize, update, and retrieve long-term information-is under-evaluated due to the lack of benchmarks.
arXiv Computation and Language
1d ago
Harness the Memory: A Holistic Evaluation of Memory Substrates in Memory Agents
The paper presents a comprehensive evaluation of 11 memory substrates for long‑horizon LLM agents, using a unified set of 26 performance and efficiency metrics across three backbone models and four benchmark suites. It finds that no single substrate consistently outperforms others; retrieval‑heavy substrates aid long‑context factual QA but can impair sequential decision‑making, and scalability can shift performance trade‑offs. The study demonstrates that selecting a memory substrate tailored to the operating regime yields better results than any fixed choice, offering empirical guidance for designing efficient, reliable, and regime‑aware long‑term memory systems.
Hugging Face Trending Papers
Oct 15
All-in-One Memory: Process-Rewarded Reinforcement Learning for Memory Agents
Large language models increasingly rely on external memory to answer queries grounded in long-horizon histories such as multi-session dialogues and lengthy documents. However, existing memory methods...
arXiv AI
Oct 16
All-in-One Memory: Process-Rewarded Reinforcement Learning for Memory Agents
All-in-One Memory (AiO-Mem) is a reinforcement learning framework that unifies memory retrieval, writing, and stopping decisions into a single reward space. It compiles diverse histories into traceable multi‑view events, uses a unified policy actor to generate interaction trajectories, and employs a trajectory‑conditioned process reward model trained with supervised fine‑tuning and DPO. Experiments on long‑context memory benchmarks show AiO‑Mem consistently improves answer accuracy compared to static memory systems and other RL‑trained agents.
arXiv AI
Jul 28
MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents
arXiv:2607. 24097v1 Announce Type: new Abstract: Memory-augmented LLM agents typically answer queries by retrieving relevant memories and feeding them directly to an answer model.
Hugging Face Trending Papers
Jul 15
Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks. Yet nearly all existing approaches, from graph-structured memories to reflective insight stores, access memory through fixed, hand-designed heuristics.
arXiv AI
Jul 16
Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
arXiv:2607. 13591v1 Announce Type: cross Abstract: Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks.
arXiv AI
Jul 15
MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
arXiv:2607. 12893v1 Announce Type: new Abstract: Long-term memory has become a foundational capability for LLM-based agents that accompany users across extended, multi-session interactions.
arXiv Machine Learning
Aug 4
Stop When Memory Suffices: Evidence-Conditioned Progressive Execution for LLM Agents
arXiv:2608. 01285v1 Announce Type: new Abstract: The continued development of LLMs toward persistent and adaptive intelligence increasingly requires long-term memory mechanisms that preserve and reuse information across interactions.
arXiv AI
1d ago
Route to Remember: Adaptive Memory Selection for LLM Agents
The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.
arXiv Machine Learning
Aug 4
LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
arXiv:2608. 02515v1 Announce Type: cross Abstract: Long-running assistants and agents consume interaction streams that eventually outgrow the context.