arXiv Machine Learning

Epistemic Memory: A Validity Layer for Self-Maintaining Intelligent Systems

The paper introduces epistemic memory, a validity-maintenance layer for intelligent systems that tracks when stored knowledge remains applicable. It formalizes a dynamic epistemic quotient and shows that fixed semantic representations inevitably incur error as epistemic boundaries shift. The authors propose Observable Belief Memory (OBM), which combines current epistemic quotients, belief over quotient classes, and within-class provenance, and demonstrate that explicit epistemic tracking improves robustness under changing observation conditions.

arXiv Computation and Language
5d ago

A State Change Is Local, Its Consequences Are Not: Dependency-Aware State Revision for Long-Term Agent Memory

The paper introduces StateGraph, a system for dependency-aware state revision in long-term agent memory. It constructs an evolving state dependency graph from interaction histories and uses counterfactual verification to determine which dependent states should be invalidated when an upstream fact changes. Evaluation on the new StateChangeBench benchmark shows StateGraph outperforms a CUPMem baseline, suggesting that explicit dependency tracking can improve selective memory revision under changing conditions.

By Yiqi Wang, Tongyuan Zhao, Jiaqi Zhang, Yiqun Duan, Zhangkai Wu, Mingkai Zheng, Taotao Cai
arXiv AI
Oct 21

More Memory, Worse Agents: Error Reproduction and Anti-Persistence in LLM Agents

The paper investigates how large language model (LLM) agents can improve performance by storing and reusing experience in external memory. It identifies a problem called error reproduction, where mistakes in stored abstractions propagate through cycles of abstraction, execution, and re-abstraction, leading to persistent errors. To mitigate this, the authors propose Anti-Persistence, a memory design that retains raw trajectories and outcomes but reconstructs task-specific guidance on demand, discarding it after use. Experiments across multiple benchmarks show that Anti-Persistence yields higher held‑out success rates and lower LLM‑call costs compared to other memory designs, supporting the idea of separating experience accumulation from abstraction persistence.

By Ruhan Wang, Kishan Panaganti, Dongruo Zhou
arXiv AI
Oct 1

Beyond the Shadows of Plato's Cave: Evaluating False Memory in Autonomous Agents via Counterfactual Reasoning

The paper introduces FAME, a training‑free framework that evaluates false memory in autonomous agents by tracking how their internal beliefs shift under counterfactual scenarios. False memory, defined as biases arising from spurious correlations, environment shifts, or knowledge conflicts, is hard to detect with standard methods. FAME measures concept drift in hidden states, achieving AUROCs between 76.2% and 96.7% and outperforming baselines on benchmarks such as GSM‑Symbolic, GitChameleon, and BigBench‑Hard.

By Quan M. Tran, Zhuo Huang, Zhen Fang, Jing Zhang, Mingming Gong, Tongliang Liu
arXiv AI
Oct 23

PreCoMem: Predictive Cognitive Memory for Self-Evolving Long-Term Dialogue Agents

PreCoMem introduces a memory consolidation framework for long‑horizon dialogue agents, inspired by predictive coding. It represents user memory as confidence‑weighted beliefs and uses an Effective Surprisal signal to decide whether to maintain, profile, or correct each belief. Experiments on LoCoMo, LongMemEval‑S, PersonaMem‑v2, and the new DiMoBench demonstrate state‑of‑the‑art accuracy and robust adaptation to non‑stationary belief drift without over‑reacting to noise.

By Jian Zhong, Zeyu Liu, Pingchuan Cao, Rongduo Han, Shunye Tang, Guohuan Xie, Mingyuan Qin, Ran Ji, Xiao Liang, Wei Wang, Haining Zhang
arXiv AI
Oct 2

Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States

Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States introduces PoS, an inference-time framework that builds and maintains explicit belief states to guide large language model agents. Each belief state combines an estimate of the current world with unresolved task requirements, making clear what the agent still needs to learn and accomplish. PoS validates consistency, monitors task progress to detect Belief Trapping, and tailors recovery to the trapping pattern and unresolved requirements, achieving top performance across four benchmarks with all three LLM backbones.

By Yu Luo, Jiamin Jiang, Yimin Zuo, Xidao Wen, Rongchen Gao, Yongqian Sun, Shenglin Zhang, Guiyang Liu, Cheng Zhang, Fang Situ, Qi Zhou, Dan Pei
arXiv AI
Oct 31

EpiAgent: Epistemic Self-Play for LLM Agents

EpiAgent introduces an explicit, learnable epistemic layer for large language model agents, enabling them to maintain and update beliefs about other agents’ private information. The framework splits the policy into Epistemic Update and Action Planning stages, optimized via a bi‑level Epistemic Self‑Play algorithm that rewards accurate belief predictions. Experiments in mixed and competitive settings show EpiAgent outperforms prompting and RL baselines, highlighting the benefits of dedicated epistemic training for belief inference and action planning.

By Xuanfa Jin, Xinyu Cui, Zhijian Ma, Xue Yan, Jian Zhao, Haifeng Zhang, Jun Wang