arXiv AI

Plans Fade Fast: Why Context Management Is Load-Bearing for LLM Agents

arXiv AI
Sep 28

Compress What You See, Not What You Say: Anchored Context Distillation for Latent-Observation Software Engineering Agents

The paper introduces LOHA, a context layout that compresses older tool observations into soft tokens while keeping the agent’s own turns and the last K observations in plain text, and ACD, a training method that distills full‑text predictions into this latent representation while anchoring behavior on plain text. This approach reduces context per call by up to 57% without significant loss in resolve rates, and improves instance throughput in single‑GPU serving. Experiments on SWE‑bench Verified show that K=3 yields a 43–57% compression with only modest performance impact, while larger windows favor task performance over compression.

By Zhensheng Zou (Peking University), Guoqing Wang (Peking University), Dan Hao (Peking University)
arXiv AI
Sep 11

Grounded Continuation: A Linear-Time Runtime Verifier for LLM Conversations

Grounded Continuation introduces a runtime verifier that classifies each utterance in an LLM conversation into one of eight epistemic operations and uses a symbolic engine to maintain a dependency map of claims and their supports. The verifier checks whether a new continuation is grounded by walking this map, a linear-time process that requires no additional LLM calls. On benchmarks such as ReviseQA and MemoryAgentBench, the verifier improves single-hop accuracy for several QA models, even enabling a 7B model to outperform GPT‑4o when guided by the verifier.

By Qisong He, Jinwei Hu, Xinmiao Huang, Changshun Wu, Yi Dong, Xiaowei Huang
arXiv AI
Oct 9

FlowState: Execution State as Memory for Long-Horizon LLM Agents

FlowState introduces a method for long-horizon LLM agents to treat execution state as a reusable memory, preserving semantically typed state nodes and their relations while separating persistent retention from on-demand access. The system uses Incremental State Update to maintain current state and Progressive State Access to reveal historical states during reasoning, allowing agents to reassess past decisions with new information. Experiments show FlowState improves success rates on MemoryArena and pass rates on τ³‑Bench by 4.55 and 13.95 percentage points, respectively, while cutting token consumption by over 40%.

By Minghao Li, Bangyan Li, Zifan Wang, Yulong Li, Hu Xu, Gan Zhang, Jingtong Wu, Wenqiang Xu