arXiv AI
Nov 6

Persistent Retrieval for Conversational Agents: A Study of Retrieval Efficiency

The paper investigates how different retrieval designs affect conversational agents. Three approaches are compared: skill-based retrieval in the main agent, a non‑persistent retrieval subagent that generates findings, and a persistent retrieval subagent that keeps history and returns evidence to the main agent. The persistent design reduces token usage and API cost by 43.3% and 45.0% respectively, cuts response time by 9.1%, and allows the main agent to request corrections from the subagent.

By Karthik Ravula, Sathwik Kowtha, Rishabh Verma, Kala Mehak Jain, Gunjit Mittal