arXiv Computation and Language

MemShift: Separating Detection from Repair in LLM-Derived Personal Memory

arXiv Computation and Language
Sep 23

MoM: Memory of Memory

arXiv:2609.25054v1 Announce Type: new Abstract: For a long-horizon LLM agent, the memory question is not what was once recorded but what \emph{currently holds}. Most designs answer it only indirectly...

By Bowen Qin, Yao Lu
arXiv AI
Oct 9

MemTrace: State-Consistent Memory for Long-Horizon Coding Agents

MemTrace is a provenance‑aware memory system designed to help coding agents handle long‑horizon software evolution tasks that span multiple files and stages. It stores execution history as immutable Memory Traces linked to key artifacts (files, symbols, tests) and organizes them in a Memory Trace Graph to track execution order and dependencies. When context budgets are limited, the system keeps only compact Memory Anchors, from which the agent can reconstruct the latest execution state and retrieve only valid, relevant evidence, improving performance on three long‑horizon coding benchmarks. "whyItMatters":"By preserving consistent task state and verifying evidence validity, MemTrace enables coding agents to outperform existing baselines on long‑horizon benchmarks, achieving significant gains in pass@1, resolved rate, and milestone scores."

By Hongming Xu, Le Zhou, ZhongHe Jin, Xiang Zhang, Bo Tang, Zhiyu Li, Xuanhe Zhou, Juncheng Zhang
arXiv Computation and Language
Oct 27

FlexA-Mem: Budget-Adaptive Agentic Memory for LLM Agents

arXiv:2610.33274v1 Announce Type: new Abstract: Large language model (LLM) agents work in scenarios with very different memory needs. A question about past conversations needs the exact facts it name...

By Wujiang Xu, Jiaojiao Han, Xi Zhu, Qizheng Zhang, Kaiqu Liang, Yutong Yin, Kai Mei, Dimitris N. Metaxas
arXiv AI
Oct 2

Mem++: Non-Destructive Memory for Long-Term Organizational LLM Agents

Mem++ is a non‑destructive memory framework for large language model agents that records every document in full, along with its date and author, instead of compressing it at write time. At read time, it retrieves only documents up to the requested time and fuses lexical and semantic rankings, leaving the choice of which version to use to the answering model. Evaluations on OrgMemBench show Mem++ outperforms the strongest baseline by 8.0 to 13.1 points and achieves the best overall score with gpt‑4.1‑mini, while also ranking highly on other benchmarks such as LoCoMo and LongMemEval‑S.

By Ahmad Yehia, Aly O. Abdelkareem, Islam Ahmed, Hesham Omran, Khaled Alashmouny, Christian Claudel, Abduallah Mohamed
arXiv AI
Oct 16

MemScope: Evolving Agent Memory Architectures through Localized Code Repair

MemScope introduces a framework for evolving large language model (LLM) agent memory architectures by using localized code repair guided by detailed execution traces and runtime memory states. The Patch Agent identifies precise repair targets and applies bounded, in-place edits while respecting provider identity and memory compatibility constraints. Experiments on GAIA, xBench, and ALFWorld show that MemScope improves accuracy and correct answer rates, achieving higher success rates with a modest median code‑change ratio of 4.4%.

By Miao Su, Yucan Guo, Zixuan Li, Long Bai, Zhongni Hou, Xiaolong Jin, Jiafeng Guo
arXiv AI
Sep 10

When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents

The paper introduces MERIT, a benchmark that evaluates the marginal benefit of long‑term memory for tool‑using large language model agents while explicitly accounting for cost. MERIT provides episodic tool‑use tasks across three domains, verifies dependence on earlier‑episode facts, and measures memory operations in tokens and dollars. Experiments on GPT‑4.1‑mini, Claude Haiku 4.5, and Claude Sonnet 5 show that memory can significantly improve task success, but its utility varies widely across models and memory implementations, and full replay is rarely cost‑effective.

By Shweta Mishra, Shashank Mishra