The paper introduces RD-Forget, a training‑free framework that separates what a persistent language agent stores from what it uses at answer time. It keeps a source archive of all observations while a query‑conditioned memory view filters evidence relevant to the current question, using a frozen language‑model curator to group facts into semantic slots and preserve multi‑hop relations. The approach employs rate‑distortion principles to stay within a memory budget and demonstrates improvements across conversational memory, knowledge updating, fact consolidation, long‑context reasoning, and personalization tasks.
By Yuhang Li, Yuchen Li
The paper introduces Temporal State Tracking Memory (TEM), a training‑free framework that stores facts as versioned records linked to their sources and retrieves the relevant versions in source order, labeling historical records before passing them to the answer model. TEM incorporates event memory and original dialogue turns to fill gaps in structured facts. Evaluations on 420 questions from 600 sessions with 60 personas show high key‑entity hit rates (75.71–97.62%) and significant improvements when historical labels are added, while keeping evidence compact (94–118 tokens per answer).
By Pengfeng Song, Yunkai Zhuang, Liye Shi
APDMem is a hierarchical long‑term memory system for personalized LLM assistants that uses progressive disclosure to retrieve conversation history. It organizes memory into four layers—thematic summaries, personalized key facts, turn‑level evidence notes, and raw messages—and a controller reads from the top layer, drilling down only when necessary. This approach balances cost and fidelity, allowing simple queries to finish early while deeper inspection is triggered for complex or exact‑evidence requests, and a note synthesizer structures retrieved evidence before answer generation. Experiments on LongMemEval show APDMem performs strongly while accessing only 8% of the total conversations.
By Chin-Lun Fu, Anagha Kulkarni, Hong Ni, Behrouz Madahian
The paper introduces AMA, a framework that uses multiple agents—Constructor, Retriever, Judge, and Refresher—to manage memory for large language model agents. AMA’s hierarchical memory design dynamically adjusts retrieval granularity to match task complexity, while the Judge and Refresher ensure relevance, consistency, and timely updates. Experiments on long-context benchmarks show AMA outperforms existing baselines and cuts token usage by about 80% compared to full-context approaches.
By Weiquan Huang, Zixuan Wang, Hehai Lin, Sudong Wang, Bo Xu, Qian Li, Beier Zhu, Linyi Yang, Chengwei Qin
arXiv:2607. 24097v1 Announce Type: new Abstract: Memory-augmented LLM agents typically answer queries by retrieving relevant memories and feeding them directly to an answer model.
By Yiwen Ma, Songjun Tu, Qichao Zhang, Dong Li, Linjing Li, Dongbin Zhao
EdgeMem is a new agent-memory method that preserves original interaction turns and organizes them using complementary content, temporal, and episodic cues via a multi‑anchor hypergraph. It performs lightweight local processing, returning source evidence directly and reserving LLM use only for final answer generation. Experiments on LoCoMo and LongMemEval‑S demonstrate strong retrieval and memory‑grounded question answering, with EdgeMem achieving the highest strict‑judge score among seven systems on LoCoMo while requiring no generative‑LLM calls for construction and retrieval.
By Zeyang Cui, Jiannong Cao, Zhiyuan Wen, Bo Yuan, Junlan Feng, Shengyuan Chen
arXiv:2609.07093v2 Announce Type: replace
Abstract: Retrieval-augmented generation (RAG) enables large language models (LLMs) to answer questions by accessing external knowledge and has been widely a...
By Yifan Wang, Xinkui Lin, Yongxiu Xu, Shen Gao, Ruochen Yang, Kun Huang, Yubin Wang, Jie Wu, Wei Liu, Jian Luan, Hongbo Xu, Shuo Shang
The paper introduces AMBER, an append‑only memory framework for language‑model agents that interact over long horizons. AMBER lets agents jointly learn to reason, act, and write free‑form memory, guaranteeing retention by construction and enabling end‑to‑end reinforcement learning without extensive curated data. Experiments on WebArena Lite show AMBER outperforms overwrite‑based memory by 4.09 percentage points in average success and improves task completion rates in repeated runs.
By Chinmay Savadikar, Zhaoyu Zhang, Mingyu Zhao, Shuang Xie, Han Li, Tianfu Wu, Lingyun Wang
CAVE-Mem is a training‑free framework that enhances memory search for long‑term memory agents by treating experience as a typed intervention operator with conditions on applicability, boundary, and utility. It first retrieves a base answer and then only applies an intervention if the operator matches the current memory substrate, answer contract, evidence boundary, and cross‑fitted utility; otherwise it abstains. Experiments on conversational memory, multi‑hop QA, and long‑document reasoning demonstrate consistent improvements over relevance‑only experience reuse.
By Xinyu Li
The paper introduces a streaming-recall benchmark that separates retention and selection decisions for persistent agents. It shows that query‑aware selection boosts recall by 15.5 points when access is fixed, while mixed comparisons inflate gains due to changes in history access. The study finds that under bounded retention, failures stem from eviction rather than ranking errors, and that dense retrieval can outperform lexical retrieval on natural text.
By Juli Huang
arXiv:2606. 28349v1 Announce Type: cross Abstract: Long-context reasoning requires models to access, retrieve, and integrate evidence scattered across documents, dialogues, and accumulated interaction histories.
By Zeju Li, Ziyang Zheng, Yizhou Zhou, Qiang Xu
The paper introduces T‑Mem, a memory framework that uses temporal structure to manage long‑horizon multi‑party conversations. It employs Temporal Evidence Discovery to find locally concentrated evidence, Temporal Memory Structuring to model state transitions and compress low‑information spans, and Evidence Forest Linearization to serialize the evidence for answer generation. Experiments on two benchmarks show that T‑Mem outperforms existing memory frameworks across various settings.
By Junyou Guo, Chongyang Tao, Yan He, Yong Wang, Shuai Ma