arXiv AI

Diagnosing Capability Preservation and Task Sensitivity in Memory Augmented Document Classifiers

The paper introduces Protected QL Memory, a dual‑path document classifier that separates a causal local pathway from an associative matrix writer and a finalized memory reader. It evaluates three empirical properties—capability preservation, diagnostic access, and task performance sensitivity—across nine dataset‑seed conditions, finding that writer capability is fully preserved while diagnostic accuracy gaps are large but macro‑F1 scores change minimally. The study concludes that preserving associative capability and diagnostic access does not guarantee downstream reliance on memory, urging separate evaluation of these objectives.

arXiv AI
Oct 9

What to Admit and How to Present: Governing Persistent Memory in LLM Agents

The paper introduces two inference‑time designs—factor‑compiled admission (FC) and permission‑semantic admission (PS)—to govern persistent memory in large language model agents without retraining. FC evaluates entire memory entries, while PS decomposes entries into typed units, both using deterministic policies to decide what recalled information enters the working context and how it is expressed. Experiments on a development suite and an external benchmark show that FC and PS reduce failure rates and cross‑domain leakage compared to verbatim injection, though they increase personalization failures and do not meet all preregistered criteria.

By Chang Liu, Deliang Ding
arXiv AI
Oct 2

Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval

The paper introduces Causal Memory Policy (CMP), a framework that identifies the utility of memories in memory‑augmented language models by intervening on retrieval rather than on storage. CMP reserves fixed context slots for memories sampled with known propensities and estimates utility using self‑normalized inverse propensity weighting, providing unbiased estimates and exact variance. Experiments show that CMP improves discrimination between required and non‑required memories and reveals that identified utility alone is insufficient for retention decisions across unseen queries.

By Arman Behnam, Binghui Wang
arXiv AI
Oct 7

The Right Memory in the Wrong Context: Verifying Retrieval Admissibility in Long-Term Agent Memory

The paper presents a retrieval‑admissibility verification framework for long‑term memory agents, classifying each memory‑query pair as admissible, inadmissible, or unresolved. It evaluates the framework on public benchmarks (RHELM and MemOps), showing improved anchor recall and reduced exact similarity errors, while also revealing that existing verifiers miss certain inadmissible exposures. The study highlights the need for separate checks on candidate support, admissibility, prompt exposure, and answer disclosure to ensure safe memory retrieval.

By Zi Wang, Xingqiao Wang, Emmanuel Addai, Devika Ambekar, Xiaowei Xu
arXiv Computation and Language
Oct 16

Writability and the Pathway: A Controlled Study of Knowledge Injection into Addressed Memory

The paper investigates how to inject knowledge into addressed memory modules of language models. Using controlled experiments on GPT‑2 and production‑memory tests on Qwen3.8‑Flash‑Next‑FP8 and DeepSeek‑V4.1‑Flash, the authors compare row‑only and row‑plus‑projection updates, with and without fixed module‑residual anchoring. Results show that while anchoring reduces drift, lexical hits do not guarantee entity‑specific retrieval, and first‑token rankings alone do not ensure full answer success, indicating that writable memory is feasible but limited in scope.

By Wei Gao (Shibei Qiyuan AI Technology), Cheng Tian (Shibei Qiyuan AI Technology), Duan Yang (Xi'an Jiaotong University), Jianqing Yin (Shibei Qiyuan AI Technology)
arXiv AI
Oct 5

Auditing Long-Term Memory Evaluation: Repeated Judging, Reader Variation, and Negative Controls

The report audits a long‑term‑memory retrieval chain on 500 LongMemEval‑S development questions, evaluating reader performance under an adapted GPT‑4o rubric. Scores vary widely across reader lanes (93–479), with the strongest lanes scoring 479 and 475, and re‑judging the same pass‑1 answers changes three labels, yielding 478. Fixed‑answer knowledge‑update re‑scoring achieves 70/72 or 69/72 depending on the template, and a different‑family reader scores 474, just 1.0 percentage point below the headline pass. The study also reports that live reader request bodies were not retained, that 18 of 23 gains occurred where baseline packets lacked evidence, and that a negative control rejects a verifier that repairs some wrong drafts but breaks many correct ones. Overall, the findings do not establish a new leaderboard leader or a transferable memory advantage, and the released artifacts support packet inspection and re‑scoring but do not reconstruct the method.

By Christopher J. Chanhnourack
arXiv AI
Aug 19

D$^2$ACCI: A Dual-Loop Diagnostic Protocol for Evidence-Preserving Agent Memory

The paper introduces D$^2$ACCI, a dual-loop diagnostic protocol designed to improve evidence-preserving memory in large language model agents. It provides a structured framework that uses paired evidence, protected-slice monitoring, and trace-level localizability to decide whether to promote, flag, or reject memory interventions. The authors also present DCR, a metric for measuring failure localizability, and D$^2$ACCI‑Eval, a reusable artifact for gate replay, demonstrating significant performance gains on three public benchmarks and highlighting the importance of traceable, statistically grounded diagnostics.

By Xule Liu, Yijun Liu, Chao Li, Shao Kun