The paper introduces Coca-Cola, a continuous latent context compression model that transforms raw tool outputs into latent tokens for LLM agents, bypassing the need for explicit text representation. By embedding these latent tokens into the agent’s input space and employing Action‑Preserving Training, the method ensures that decision‑critical information is retained while reducing token consumption by 70.01%–89.24%. Experiments on web‑search agents across multiple QA benchmarks demonstrate significant reductions in runtime (24.45%–55.97%) and consistent improvements in task performance.
By Yuetong Liu, Zhehao Zhou, Yitong Zhang, Haorui Chen, Jia Li
Paritok-4B is a 4‑billion‑parameter LoRA compressor designed for coding agents, which extracts and retains key spans of code rather than paraphrasing them. It is intent‑conditioned, selecting lines that are most relevant to the agent’s current task, and achieves high fidelity with 96% of identifiers, paths, and numbers preserved. Trained on 67,074 real OpenHands trajectories and fine‑tuned on Qwen3‑4B, it compresses agent context to about 25.7% of its original size while keeping 86.5% of the uncompressed solve quality across 300 SWE‑bench Lite instances.
By Jiayu Shi, Luzhuo Chen
arXiv:2608.21690v1 Announce Type: new
Abstract: LLM agents increasingly take on long-running tasks whose history grows far beyond a single model context window. Existing approaches compress earlier i...
By Yin Lin, Elaine Ang, Erkang Zhu, Bolin Ding, Jingren Zhou
Folio is a context‑management system for long‑horizon language agents that records and folds conversation history into three linked levels—short turn notes, event manifests, and source records—allowing the agent to programmatically compress older turns while preserving recoverable handles. By printing these handles, Folio enables efficient recovery and analysis of the full history with minimal additional input. In benchmark tests on 75 LOCA‑bench tasks, Folio outperformed existing model‑written compaction methods, solving 66 tasks versus 54, and reduced runtime cost by 2.4× while keeping fold times around 0.6 seconds.
By Yubo Ruan, Tao Peng, Jiao Zhang, Chuanguo Ma, Lei Xu, Han Zhou, Wenwu Wang, Xiafei Lv, Xingjie Zhou, Guiju Fan, Hao Wang, Fenghui Zhang, Mao Miao, Shuo Li
The paper introduces Dynamic Tool Output Compression (DTOC), a framework that manages context in large‑language‑model agents by storing full tool outputs in external memory and inserting compact placeholders into the active context. DTOC treats context updates as explicit, reversible operations within the agent’s reasoning loop, allowing selective reconstruction of compressed outputs when needed. Experiments on the DeepSWE benchmark show that for responsive models such as Sonnet 4.6 and GPT‑5.4, DTOC reduces input tokens and agent steps while significantly improving solve rates and lowering cost per solved task, with ablation studies confirming the importance of reversibility for maintaining performance.
By Abhay Chaturvedi, Shreya Bhattacharya, Rashmika Gopalkrishnan, Peter van der Putten
The paper introduces CTXAgent, a self‑controlled context management system for large language model agents that compacts conversation history when a token threshold is reached. It evaluates seven frontier models, comparing their ability to manage context with and without dedicated tools, and benchmarks performance across coding, scientific, and software engineering tasks. Results show that well‑managed models keep live context below 100k tokens, maintain high benchmark scores, and achieve significant cost reductions, with Claude Opus 5.5 outperforming its explicit configuration by 34% lower cost.
By Matthias Busch, Marius Tacke, Roland C. Aydin, Christian Feiler, Christian J. Cyron