arXiv AI

When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary

arXiv:2608. 01679v2 Announce Type: replace Abstract: Persistent memory allows (self-evolving) LLM agents to adapt across tasks by consolidating heterogeneous interaction histories into reusable facts, preferences, observations, and rules.

arXiv AI
Sep 3

Agent Memory Is a Surface for Endogenous Authorization Laundering

Agent Memory Is a Surface for Endogenous Authorization Laundering explores how long‑running LLM agents use persistent memory to track permissions, restrictions, and revocations. The paper shows that when memory misrepresents evolving authorization states, agents can grant themselves authority that the underlying history never permitted, a phenomenon the authors call endogenous authorization laundering. To study this, the authors introduce EAL‑Bench, evaluate several LLMs across domains, and find that memory writers can create false authority in up to 50.2% of cases, which executors then act upon in 98.6% of trials. Two safeguards—requiring stored permissions to be backed by valid source events and tracking permission changes through bounded event sourcing—reduce laundering but also reject more legitimate actions, highlighting a safety‑utility tradeoff.

By Tommaso Cerruti, Mika Okamoto, Ansel Kaplan Erol
Hugging Face Trending Papers
Jun 29

Always-OnAgents:A Survey of Persistent Memory, State, and Governance in LLMAgents

Always-on agents are systems whose future behavior depends on durable state accumulated across earlier interactions. We treat them as persistent-state systems: the operative system includes retrievable memories, but also task ledgers, permissions, credentials, commitments, provenance and audit records, shared state, trigger conditions, and externally committed effects linked to those records.

arXiv AI
Jun 12

A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecycle

arXiv:2604. 16548v2 Announce Type: replace-cross Abstract: The emergence of writable, cross-session persistent memory in LLM agents introduces a qualitatively different threat landscape from conventional input-centric security concerns, characterized by three properties: persistence, statefulness, and propagation.

By Zehao Lin, Xixuan Hao, Renyu Fu, Shaobo Cui, Kai Chen, Chunyu Li, Zhiyu Li, Feiyu Xiong
arXiv AI
Jun 10

Deployment-Time Memorization in Foundation-Model Agents

arXiv:2606. 10062v1 Announce Type: new Abstract: Foundation-model agents are increasingly long-lived systems that remember users across interactions, making memorization an explicit deployment-time function rather than solely a property of model weights.

By Lei (Rachel), Chen, Guilin Zhang, Kai Zhao, Dalmo Cirne, Andy Olsen, Xu Chu, Zeke Miller, Alet Blanken, Amine Anoun, Jerry Ting
arXiv AI
4d ago

CoSec: Benchmarking Agent Security in Communities

arXiv:2609.34790v2 Announce Type: replace-cross Abstract: LLM agents operate in persistent collaborative environments involving multiple users, communities, memories, files, and tools. Community boun...

By Hao Chen, Wenhui Dong, Ye Chen, Jiezhi Yao, Chenbo Xia, Yuwen Qu, Renxiang Wang, Fudong Yuan, Camil Hamami, Chenglong Pan, Xinquan Yue, Ziyu Wang, Fengyu Ye, Chenyang Si, Caifeng Shan