arXiv Computation and Language

MemFold: Learning Compact Soft Memory for Long-Context Personalization via On-Policy Optimization

arXiv AI
Sep 4

Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning

The paper introduces LRE (Learned Relevance Eviction), a lightweight, CPU‑only, language‑model‑free scorer that learns which parts of an agent’s interaction history are task‑critical and preserves them verbatim. In experiments, LRE matches or surpasses baseline eviction policies on accuracy‑cost trade‑offs, recovers 93% of full‑history accuracy, reduces worst‑case prompt size by 52%, and outperforms dense and token‑pruning encoders in conversational memory while being 295–1569× smaller. The method also achieves superior budgeted answer quality on LoCoMo reading and can be trained annotation‑free, recovering 95% of supervised scorer performance.

By Nusrat Jahan Lia, Aritra Mazumder
arXiv AI
Oct 26

Lifelong Context Adaptation through Bidirectional Memory-Skill Learning

The paper introduces MemCryst, a framework that enables lifelong learning for large language model agents by jointly adapting memory and skills while keeping the language model frozen. MemCryst stores recurring episodes in memory to support skill creation and revision, and uses the resulting skills to guide future interactions, which in turn generate new memory. Experiments across ten diverse settings—including embodied control, long-document reading, conversation, mathematics, and code—show that MemCryst outperforms memory-only and skill-only baselines, achieving 63.17% success on ALFWorld.

By Tianyi Xu, Huazheng Wang
arXiv AI
Oct 16

Memorilla: Latent Semantic Memory for LLMs

Memorilla is a memory system that encodes an entire document collection into reusable embeddings and retrieves query‑specific information as a fixed set of memory tokens for a frozen large language model. Using only 16 memory tokens, it outperforms baselines such as Mem0 and MemoRAG on most benchmarks, achieving higher accuracy on FactKG while drastically reducing token usage. In agentic settings, Memorilla helps prevent wandering and boosts success rates in a TextWorld environment, demonstrating its utility for continual learning and long‑context interactions.

By Adibvafa Fallahpour, Parsa Idehpour, Vignesh Kothapalli, Nikita Mounier, Shirley Wu, Shayan Pardis, Jure Leskovec
arXiv Computation and Language
Oct 27

FlexA-Mem: Budget-Adaptive Agentic Memory for LLM Agents

arXiv:2610.33274v1 Announce Type: new Abstract: Large language model (LLM) agents work in scenarios with very different memory needs. A question about past conversations needs the exact facts it name...

By Wujiang Xu, Jiaojiao Han, Xi Zhu, Qizheng Zhang, Kaiqu Liang, Yutong Yin, Kai Mei, Dimitris N. Metaxas
arXiv AI
Jul 16

Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents

arXiv:2607. 13591v1 Announce Type: cross Abstract: Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks.

By Eric Hanchen Jiang, Zhi Zhang, Yuchen Wu, Levina Li, Dong Liu, Xiao Liang, Rui Sun, Yubei Li, Edward Sun, Haozheng Luo, Zhaolu Kang, Aylin Caliskan, Kai-Wei Chang, Ying Nian Wu
arXiv AI
Aug 28

When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systems

The paper introduces CoVeMem, a Collaborative Vector Memory system that replaces text-based memory in agentic recommender systems with vectorized user and item states derived from a frozen LightGCN model. By retrieving relevant historical states at each decision and integrating them as soft tokens in the LLM’s context, CoVeMem enables contrastive alignment and listwise co‑training to learn how to read and rank these states, achieving performance on par with or better than existing text‑memory agents across multiple benchmarks without extra LLM calls for memory updates.

By Hanchong Chen, Xing Tang, Lingjie Li, Xiongfeng Shan, Xiuqiang He
arXiv AI
Aug 20

rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation

The paper introduces rEDMRec, a method that compresses a large language model’s reasoning about user preferences and item comparisons into a compact, editable memory. This memory, organized into four channels—long‑term preference, short‑term context, item perception, and counterfactual hard‑negative comparisons—can be updated by an LLM controller and queried by a lightweight student LLM for ranking, eliminating the need to re‑run the expensive teacher model for each request. Experiments on ML‑1M, Amazon Beauty, and Steam datasets show that rEDMRec consistently outperforms zero‑shot, few‑shot, RAG, and GraphRAG baselines, achieving up to a 13.3% improvement in HR@1 on ML‑1M.

By Minh Hoang Nguyen, Tung Le, Huy Tien Nguyen
arXiv AI
Aug 18

QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents

arXiv:2608. 16168v1 Announce Type: cross Abstract: Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence.

By Heng Wang, Yifei Li, Lingling Zhang, Pengyu Li, Xinyu Che, Xinyu Zhang, Zesheng Yang