arXiv Computation and Language

IACM-RL: Intent-Aware Context Management and Reinforcement Learning for Complex Tool Invocation under Dynamic Intent Fluctuations

arXiv Computation and Language
Aug 31

ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL

ContextPilot is a proactive context‑management framework designed to improve long‑horizon agentic reasoning with large language models. It expands the toolset to include planning, long‑term memory, and soft context offloading, and introduces a reinforcement‑learning strategy that focuses on critical editing decisions and assigns action‑level advantages. Experiments on long‑context QA and deep search tasks demonstrate that ContextPilot achieves stronger performance with a more compact working context, outperforming existing baselines across various base models and benchmarks.

By Zhuoshi Pan, Qizhi Pei, Junru Lu, Honglin Lin, H. Vicky Zhao, Di Yin, Xing Sun
arXiv AI
Sep 30

FOCUS: Training-Free Decision-Preserving Context Compression for LLM Agents

The paper introduces FOCUS, a training‑free framework that compresses the interaction history of large language model agents by preserving only the past interactions that causally influence future decisions. Unlike prior methods that learn compression policies offline, FOCUS operates entirely at test time, requiring no additional data collection or fine‑tuning and can be applied to any closed‑API model. Experiments on a variety of agentic benchmarks show that FOCUS reduces peak context length by up to 48% and dependency by 73%, while improving task success by up to 8.9 percentage points.

By Shantanu Dixit, Anson Bastos, Xuchao Zhang, Chetan Bansal, Saravan Rajmohan
arXiv Machine Learning
Oct 9

Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amap

The paper introduces GPlan, a generative framework for Generative Spatiotemporal Intent Sequence Recommendation (GSISR) that integrates large language model reasoning into lightweight models. It employs Progressive Implicit CoT Distillation to compress reasoning into latent tokens for low-latency inference, and Spatiotemporal Counterfactual DPO to align plans with real-world constraints, improving sequence coherence and context responsiveness. Experiments and online A/B tests confirm the effectiveness of these techniques, and the authors provide an implementation and dataset on GitHub.

By Sicong Wang, Ruiting Dong, Yue Liu, Bowen Zheng, Jun Meng, Jie Li, Shuaijun Guo, Yu Gu, Fanyi Di, Xin Li
arXiv AI
Jul 1

ACE: Pluggable Adaptive Context Elasticizer across Agents

arXiv:2606. 31564v1 Announce Type: new Abstract: The increasing complexity of agentic tasks has led to rapidly growing trajectory lengths, which poses significant challenges for large language model (LLM) based agents with fixed context windows.

By Ning Liao, Zihao Long, Xiaoxing Wang, Xue Yang, Yaoming Wang, Ziyuan Zhuang, Xunliang Cai, Rongxiang Weng, Junchi Yan
arXiv Machine Learning
Oct 16

Towards Reliable Context Compression for Long-Horizon Agents: An Empirical Study of Execution Instability

The paper investigates how recurrent context compression affects long‑horizon agents, finding that compression can diminish the impact of recent interactions, leading to more blocked actions, repeated exploration, and run‑to‑run instability. To address this, the authors propose TRACE, a verifier‑guided framework that evaluates individual compression events via paired closed‑loop continuations and optimizes a natural‑language compression prompt while keeping all models frozen. Early experiments on AppWorld demonstrate that TRACE improves task performance, multi‑run reliability, and context‑execution efficiency compared to existing compression baselines.

By Guanghui Min, Liang Wu, Mayank Darbari, Chen Chen, Liangjie Hong
arXiv Computation and Language
Aug 28

INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment

The paper introduces INTENT-AS-A-TOOL, a method that equips large language models with intent-targeted tools to provide a fine-grained, judge‑free signal of their commitment to specific behaviors during reasoning. By monitoring the probability of calling these intent tools, the authors can track how intent evolves throughout generation, complementing chain‑of‑thought monitoring and expanding post‑hoc labels into dense trajectories. The approach identifies critical steps for online intervention, demonstrating that action preferences are useful for detecting agentic misalignment in autonomous agents.

By Yutong Zhang, Jianshuo Dong, Peng Xu, Long Wang, Jie Zhang, Tianwei Zhang, Xiaoping Zhang, Han Qiu