arXiv AI
6d ago

From Memory Hits to Answerable Evidence: Query-Conditioned Memory Compilation for Long-Term Agent Memory

The paper introduces MemCompile, a query‑conditioned evidence compilation framework designed to improve long‑term conversational memory. It uses an Address Plane to locate relevant support via compact descriptors and capacity‑aware cells, then normalizes retrieval hits into stable SourcePacket identities. An Evidence Plane allocates a bounded evidence budget across packets, admits limited additional support, and produces answer‑ready context, achieving 80.52% Judge Accuracy on LoCoMo and improving the quality‑cost Pareto frontier.

By Shangze Li, Yanyu Yao, Derong Xu, Zhi Zheng, Tong Xu
arXiv AI
Sep 10

When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents

The paper introduces MERIT, a benchmark that evaluates the marginal benefit of long‑term memory for tool‑using large language model agents while explicitly accounting for cost. MERIT provides episodic tool‑use tasks across three domains, verifies dependence on earlier‑episode facts, and measures memory operations in tokens and dollars. Experiments on GPT‑4.1‑mini, Claude Haiku 4.5, and Claude Sonnet 5 show that memory can significantly improve task success, but its utility varies widely across models and memory implementations, and full replay is rarely cost‑effective.

By Shweta Mishra, Shashank Mishra