arXiv Computation and Language By Chuanyuan Tan, Junjie Yu, Yuxin Wang, Yining Zheng, Xipeng Qiu, Wenliang Chen

What Makes Agent Memory Useful for Reliable Unanswerable Question Handling?

Read the original on arXiv Computation and Language →

The paper investigates how agent memory contributes to reliable handling of unanswerable questions (UAQs) within a unified Retrieval-Augmented Generation (RAG) framework. Four memory methods were evaluated across three UAQ datasets and two base models, revealing that memory can improve UAQ performance in selective settings but the gains are fragile under dataset shift. Procedural and rule-based memories, especially when combined with complementary behavioral signals, provide the most reliable support, indicating that effective UAQ memory relies more on transferable behavioral guidance than on sheer volume of stored experience.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Jun 30

Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions

arXiv:2507. 05257v4 Announce Type: replace-cross Abstract: Recent benchmarks for Large Language Model (LLM) agents primarily focus on evaluating reasoning, planning, and execution capabilities, while another critical component-memory, encompassing how agents memorize, update, and retrieve long-term information-is under-evaluated due to the lack of benchmarks.

By Yuanzhe Hu, Yu Wang, Julian McAuley
arXiv AI
Aug 24

Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents

The paper introduces the Weighted Memory Tree (WMT), a hierarchical memory system for large language model agents that organizes execution histories into tasks, subtasks, and actions while assigning each memory a dynamic retention score. Event-based updates and selection-based decay allow WMT to preserve useful information, fold completed trajectories, suppress low-utility content, and retain access to folded context. Experiments on GAIA-Text with Qwen3-8B, Gemma 4 E4B, and Llama-3.1-8B show that WMT improves accuracy by an average of 9.97 percentage points and reduces prompt-token usage by 32.8%, while also limiting the persistence of unreliable information.

By Quang Dao, Purvi Kathalkar, Kenneth Eaton