arXiv AI
Oct 31

When Stored Evidence Stops Being Usable: Scale-Conditioned Evaluation of Agent Memory

The paper introduces a scale‑conditioned evaluation protocol for agent memory that measures how usable evidence degrades as irrelevant sessions accumulate. It logs memory trajectories and reports four diagnostics—budget‑compliant reliability, tail memory‑call burden, failure‑regime decomposition, and the usable‑scale boundary. Experiments on LongMemEval and LoCoMo show that reliability loss varies across memory interfaces and agents, highlighting that scalable‑memory claims must be conditioned on agent, interface, scale range, and interaction budget.

By Jiaqi Shao, Yiyi Lu, Yunzhen Zhang, Bing Luo