arXiv AI

Persistent Retrieval for Conversational Agents: A Study of Retrieval Efficiency

The paper investigates how different retrieval designs affect conversational agents. Three approaches are compared: skill-based retrieval in the main agent, a non‑persistent retrieval subagent that generates findings, and a persistent retrieval subagent that keeps history and returns evidence to the main agent. The persistent design reduces token usage and API cost by 43.3% and 45.0% respectively, cuts response time by 9.1%, and allows the main agent to request corrections from the subagent.

arXiv AI
1d ago

Route to Remember: Adaptive Memory Selection for LLM Agents

The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.

By Zeyu Fang, Jun Yin, Yongsheng Mei, Xu Han, Chaitali Joshi, Zhongkai Sun, Jie Hao, Bin Guo, Chengyuan Ma, Benjamin Z. Yao, Chenlei Guo
arXiv AI
Sep 11

What Should an Agent Forget? Separating What Is Stored from What Is Used

The paper introduces RD-Forget, a training‑free framework that separates what a persistent language agent stores from what it uses at answer time. It keeps a source archive of all observations while a query‑conditioned memory view filters evidence relevant to the current question, using a frozen language‑model curator to group facts into semantic slots and preserve multi‑hop relations. The approach employs rate‑distortion principles to stay within a memory budget and demonstrates improvements across conversational memory, knowledge updating, fact consolidation, long‑context reasoning, and personalization tasks.

By Yuhang Li, Yuchen Li
arXiv AI
Sep 10

AMA: Adaptive Memory via Multi-Agent Collaboration

The paper introduces AMA, a framework that uses multiple agents—Constructor, Retriever, Judge, and Refresher—to manage memory for large language model agents. AMA’s hierarchical memory design dynamically adjusts retrieval granularity to match task complexity, while the Judge and Refresher ensure relevance, consistency, and timely updates. Experiments on long-context benchmarks show AMA outperforms existing baselines and cuts token usage by about 80% compared to full-context approaches.

By Weiquan Huang, Zixuan Wang, Hehai Lin, Sudong Wang, Bo Xu, Qian Li, Beier Zhu, Linyi Yang, Chengwei Qin
arXiv AI
1d ago

Challenge-Aware Knowledge Recruitment with Meta-Agent Supervision for Medical Multi-Agent Reasoning

The paper introduces a challenge‑aware adaptive recruitment system for medical multi‑agent reasoning. An external CHALLENGER monitors the evolving reasoning trace to detect factual or expertise gaps, triggering targeted knowledge retrieval or specialist recruitment mid‑discussion. Experiments on the MEDAGENTSBENCH hard subset show that challenge‑aware in‑between retrieval and Challenger‑triggered specialist recruitment improve accuracy, while naive combinations degrade performance, underscoring the importance of timing and coordination in resource recruitment.

By Riccardo Riccio, Haitz S\'aez de Oc\'ariz Borde, Pietro Li\`o