arXiv AI By Yu Qian, Hong Miao, Boyang Guo, Tingyi Jiang, Shan Zhao, Tianxing Le, Lintian Li, Meng Liu

ECHO: A Cognitively Inspired, Auditable Memory Plane for Long-Horizon Agents

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Sep 10

When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents

The paper introduces MERIT, a benchmark that evaluates the marginal benefit of long‑term memory for tool‑using large language model agents while explicitly accounting for cost. MERIT provides episodic tool‑use tasks across three domains, verifies dependence on earlier‑episode facts, and measures memory operations in tokens and dollars. Experiments on GPT‑4.1‑mini, Claude Haiku 4.5, and Claude Sonnet 5 show that memory can significantly improve task success, but its utility varies widely across models and memory implementations, and full replay is rarely cost‑effective.

By Shweta Mishra, Shashank Mishra
arXiv Computation and Language
Sep 22

EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systems

arXiv:2609.22231v1 Announce Type: new Abstract: Long-horizon interactions with LLM-based assistants require memory systems that preserve and update user states, preferences, and interaction histories...

By Zeyu Liu, Jian Zhong, Rongduo Han, Ziyang Wu, Shunye Tang, Chenghao He, Yaxuan Yang, Yihang Qiu, Ailing Wang, Xiao Liang, Guohuan Xie, Xiaokang Xue, Gongchen Li, Haining Zhang, Wei Wang
arXiv AI
6d ago

From Relevant Memories to Sufficient Evidence: Rethinking Memory Utilization in LLM Agents

The paper introduces QEMem, a framework that rethinks how large language model agents use long‑term memory by constructing query‑specific evidence sets rather than relying on individual memory relevance. QEMem combines query‑guided discovery, source‑grounded reification into structured ViewCards, and sufficiency‑guided refinement to assemble comprehensive evidence from multiple memory granularities. Experiments show that QEMem achieves 91.43% LLM‑judge accuracy on LoCoMo with Claude Opus 4.5, surpassing leading baselines by significant margins and improving evidence coverage for cross‑session queries.

By Shixuan Li, Wei Yang, Peiyu Zhang, Anzhe Cheng, Heng Ping, Xiaole Zhang, Jesse Thomason, Xuezhe Ma, Yue Zhao, Paul Bogdan