arXiv Computation and Language

SPECMEM: Accelerating Agentic Tool Calling via Live Memory Management

arXiv AI
Aug 18

From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems

arXiv:2608. 15127v1 Announce Type: cross Abstract: Agentic applications are shifting AI serving from isolated model inference to long-running workloads in which LLMs coordinate tools, environments, and persistent state.

By Chaokun Chang, Yukun Zhou, Kaihua Fu, Dakai An, Tianyu Feng, Hanfeng Lu, Sheng Yao, Pu Guo, Yinghao Yu, Yizhou Shan, Bo Li, Binhang Yuan, Wei Wang
arXiv AI
Jul 28

SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving

arXiv:2607. 23933v1 Announce Type: cross Abstract: As LLM agents increasingly rely on the Model Context Protocol (MCP) to invoke isolated external sandboxes, disaggregated sandbox deployment introduces a fundamental tension between resource utilization and interactive tail latency.

By Yihui Zhang (Beihang University), Tianyu Wo (Beihang University), Jinghao Wang (Beihang University), Xiaoyang Sun (University of Leeds), Menghao Zhang (Beihang University), Cangzhou Yuan (Beihang University), Li Li (Beihang University), Chunming Hu (Beihang University), Albert Y. Zomaya (The University of Sydney), Renyu Yang (Beihang University)
arXiv AI
Oct 7

AgentMemGate: Addressing Speculation Contamination in Conversational Assistant Memory

AgentMemGate is a write-time gate for conversational AI assistants that prevents speculation contamination in long‑term memory by classifying extracted statements as speculation, completed event, correction, or other. Speculations are kept outside memory until conditions allow promotion or deletion. The approach eliminates observed contamination and improves task accuracy from 65% to 95% on core benchmarks, with further gains on a harder held‑out set.

By Chirag Sharma, Benjamin Fowlersmith, Karime Maamari
arXiv AI
5d ago

When Stored Evidence Stops Being Usable: Scale-Conditioned Evaluation of Agent Memory

The paper introduces a scale‑conditioned evaluation protocol for agent memory that measures how usable evidence degrades as irrelevant sessions accumulate. It logs memory trajectories and reports four diagnostics—budget‑compliant reliability, tail memory‑call burden, failure‑regime decomposition, and the usable‑scale boundary. Experiments on LongMemEval and LoCoMo show that reliability loss varies across memory interfaces and agents, highlighting that scalable‑memory claims must be conditioned on agent, interface, scale range, and interaction budget.

By Jiaqi Shao, Yiyi Lu, Yunzhen Zhang, Bing Luo
arXiv AI
Sep 16

EchoPath: Execution-Level Replayable Memory for GUI Agents

EchoPath is a model‑agnostic framework that transforms validated GUI interaction trajectories into standardized, parameter‑controlled memories, enabling agents to replay specific GUI actions deterministically. Each memory records task intent, preconditions, input parameters, GUI evidence, validation provenance, and lifecycle state, and uses an image‑based target‑reaiming algorithm to adjust coordinates for the current screen before execution. Experiments on real computer‑use tasks show that EchoPath cuts median token cost by over 90 % and median execution time by about 60 %.

By Yao Zhao, Aditya Shanmugham, Swastik Roy, Yanxun Xu
arXiv AI
Oct 9

FlowState: Execution State as Memory for Long-Horizon LLM Agents

FlowState introduces a method for long-horizon LLM agents to treat execution state as a reusable memory, preserving semantically typed state nodes and their relations while separating persistent retention from on-demand access. The system uses Incremental State Update to maintain current state and Progressive State Access to reveal historical states during reasoning, allowing agents to reassess past decisions with new information. Experiments show FlowState improves success rates on MemoryArena and pass rates on τ³‑Bench by 4.55 and 13.95 percentage points, respectively, while cutting token consumption by over 40%.

By Minghao Li, Bangyan Li, Zifan Wang, Yulong Li, Hu Xu, Gan Zhang, Jingtong Wu, Wenqiang Xu