arXiv AI By Karthik Ravula, Sathwik Kowtha, Rishabh Verma, Kala Mehak Jain, Gunjit Mittal

Persistent Retrieval for Conversational Agents: A Study of Retrieval Efficiency

Read the original on arXiv AI →

The paper investigates how different retrieval designs affect conversational agents. Three approaches are compared: skill-based retrieval in the main agent, a non‑persistent retrieval subagent that generates findings, and a persistent retrieval subagent that keeps history and returns evidence to the main agent. The persistent design reduces token usage and API cost by 43.3% and 45.0% respectively, cuts response time by 9.1%, and allows the main agent to request corrections from the subagent.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
1d ago

Route to Remember: Adaptive Memory Selection for LLM Agents

The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.

By Zeyu Fang, Jun Yin, Yongsheng Mei, Xu Han, Chaitali Joshi, Zhongkai Sun, Jie Hao, Bin Guo, Chengyuan Ma, Benjamin Z. Yao, Chenlei Guo