arXiv AI

The Price of Scale in Proactive Memory Recall

The paper investigates how a long‑lived assistant decides whether to interrupt a user with a memory recall, framing the decision as a multiple‑testing problem whose difficulty scales with the size of the memory store, N. Experiments on LongMemEval and LoCoMo show that a similarity threshold tuned to a 5% false‑alarm rate at N=8 achieves 87–100% hit rates at N=2048, and theoretical analysis predicts a per‑item false‑positive rate of about –ln(1-α)/N, leading to a power‑law decay of hit rate with N. The study also demonstrates that lexical and semantic channels require thresholds growing like ln N and √ln N, that per‑cue normalisation roughly doubles hit rates, and introduces a cue‑swap conformal gate that achieves near‑label‑tuned performance without labels. whyItMatters":"The work provides a quantitative understanding of how memory‑recall systems must adjust thresholds as their knowledge base grows, informing the design of more efficient and user‑friendly AI assistants."

arXiv AI
Sep 3

The Memory Trust Gap: Capability-Dependent Failures in Persistent-Memory Agents

The paper investigates how persistent memory in AI agents can lead to over‑trust in stale facts, creating a "Memory Trust Gap" that worsens as model capability increases. Using a benchmark with Benefit and Safety suites across Qwen3 models of varying sizes, the authors show that larger models are more prone to harmful over‑trust, especially when metadata is absent or misleading. They also demonstrate that mitigation strategies such as exposing metadata or pre‑resolving conflicts improve accuracy, but the effectiveness depends on model size and dataset.

By Jundong Hu, Shekar Ramachandran
arXiv AI
Jul 14

Remembering Distinct Items, Not Tokens: A Learnable Dirichlet-Process Cache Between State-Space Models and Attention

arXiv:2607. 09889v1 Announce Type: cross Abstract: Fixed-state sequence models compress an unbounded past into a bounded state, which caps their associative recall at roughly the state dimension; attention escapes the cap by keeping a key-value entry for every token, at quadratic compute and a cache that grows with the sequence.

By Siddharth Pal, Viktoria Rojkova