arXiv Computation and Language

TellOnce: Correcting Coding Agents Once, Improving Their Future Actions

arXiv AI
Oct 28

EMMA: Structured Episodic Memory for Multi-Agent Workflow Synthesis

EMMA is a framework that treats the configuration of a multi‑agent system—controller routing, specialist prompts, and procedural skills—as structured episodic memory. It explicitly assigns ownership and limits updates through a reflector and backbone‑independent guards, ensuring edits are scoped, incremental, and bounded. Experiments on KramaBench, AppWorld, and BBEH show EMMA outperforms four baselines, achieving up to 32.5% higher performance and reducing training executions by 17–38%.

By Ruijia Niu, Kaiwen Liu, Rose Yu, Kristina Klinkner
arXiv AI
Oct 21

More Memory, Worse Agents: Error Reproduction and Anti-Persistence in LLM Agents

The paper investigates how large language model (LLM) agents can improve performance by storing and reusing experience in external memory. It identifies a problem called error reproduction, where mistakes in stored abstractions propagate through cycles of abstraction, execution, and re-abstraction, leading to persistent errors. To mitigate this, the authors propose Anti-Persistence, a memory design that retains raw trajectories and outcomes but reconstructs task-specific guidance on demand, discarding it after use. Experiments across multiple benchmarks show that Anti-Persistence yields higher held‑out success rates and lower LLM‑call costs compared to other memory designs, supporting the idea of separating experience accumulation from abstraction persistence.

By Ruhan Wang, Kishan Panaganti, Dongruo Zhou
arXiv AI
Jul 14

AgentAbstain: Do LLM Agents Know When Not to Act?

arXiv:2607. 10059v1 Announce Type: new Abstract: Agent systems based on large language models (LLMs) are increasingly deployed for autonomous tasks, yet existing evaluations mostly focus on task success rather than whether agents know when to abstain.

By Xun Liu, Yi Evie Zhang, Vira Kasprova, Parisa Rabbani, Pardis Sadat Zahraei, Tianyu Zhang, Ali Ebrahimpour-Boroojeny, Varun Chandrasekaran
arXiv Computation and Language
Sep 21

MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks

MemoryArena is a new evaluation gym that benchmarks agent memory in interdependent multi‑session tasks. Unlike prior benchmarks that test memorization or single‑session action in isolation, MemoryArena requires agents to acquire memory while interacting with the environment and then use that memory to guide future decisions across a range of tasks such as web navigation, planning, information search, and formal reasoning. The benchmark reveals that agents excelling on existing long‑context memory tests perform poorly here, highlighting a gap in current memory evaluation methods.

By Zexue He, Yu Wang, Churan Zhi, Yuanzhe Hu, Tzu-Ping Chen, Lang Yin, Ze Chen, Tong Arthur Wu, Siru Ouyang, Zihan Wang, Jiaxin Pei, Julian McAuley, Yejin Choi, Alex Pentland
arXiv Computation and Language
Oct 23

Why Bother Me Again? Benchmarking Personal Agent Memory for Interaction Preferences

The paper introduces MemPABench, an interactive environment designed to evaluate how personal agents remember and act on user interaction preferences. The benchmark features long‑horizon tasks where agents must decide when to clarify, confirm, or act autonomously, using data from four simulated users who provided 99 sessions over four months and five preference changes each. Experiments across four memory systems and LLM backbones show that current memory approaches offer limited improvement in preference selection, with retrieval‑based methods performing no better than no memory and file‑based memory sometimes applying preferences in irrelevant contexts.

By Jialin Li, Zhenhao Chen, Hanjun Luo, Hanan Salam
arXiv AI
Sep 3

AdaMem: Learning What to Remember with Adaptive Memory Policies for Personalized Agents

AdaMem introduces adaptive memory policies that allow personalized agents to decide what information to write into long‑term memory based on user preferences for each interaction context. Each policy is updated from periodic feedback and controls subsequent memory writing, aiming to improve relevance and reduce unnecessary memory persistence. In experiments on AdaMem‑Bench, AdaMem raises QA accuracy from 80.0% to 84.35% while cutting persistent memory by 9.27%, though models still struggle to execute policies reliably.

By Xingyu Chen, Rui Wang, Zhaopeng Tu, Liefeng Bo
arXiv AI
Sep 24

Agent-Editing World Model: Rethinking World Modeling for LLM Agents

The paper introduces the Agent-Editing World Model (AEWM), a new approach that models how reasoning and actions influence future task progress instead of simulating tool responses. AEWM includes an Action Judge that classifies decisions as Critical, Exploratory, or Noisy, and a State Revision mechanism that edits noisy reasoning–action continuations from the same observed history. The integrated system, EditAct, directly updates the underlying state during real execution, leading to significant performance gains across multiple benchmarks and agent backbones.

By Shuang Sun, Guoxin Chen, Fanzhe Meng, Jia Deng, Huatong Song, Jinhao Jiang, Wayne Xin Zhao, Hongteng Xu, Ji-Rong Wen
arXiv AI
1d ago

Reglos: A Self-Evolving Personal Memory Agent with Recursive Self-Improvement

Reglos is a training‑free personal memory agent that continuously updates an append‑only record of user interactions, allowing newer preferences to override older ones and enabling selective forgetting of facts. Its memory harness evolves through recursive self‑improvement: a coding agent generates patches from failure traces, a critic from a second model family screens them, and a fixed evaluator decides which patches to accept. Using the same backbone across systems, Reglos surpasses state‑of‑the‑art memory agents such as Mem0, MemOS, and EverOS, achieving 61.3 % and 84.0 % on PersonaMem‑v2 and LongMemEval‑S with Qwen3.8‑27B, and 57.5 % and 87.2 % with GPT‑5.6 Luna.

By Sen Yang, Jiaduo Lin, Zehong Huang, Wen Liu