arXiv AI

AgentOCR: Reimagining Agent History via Optical Self-Compression

arXiv Computation and Language
Oct 9

GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness

GUI-KV is a plug‑and‑play key‑value cache compression method designed for graphical user interface agents that use vision‑language models. It exploits spatial saliency and temporal redundancy to prune cache entries, achieving near‑full‑cache accuracy while using modest memory budgets. Experiments on standard GUI agent benchmarks show significant reductions in decoding FLOPs and improvements in step accuracy compared to existing compression baselines.

By Kung-Hsiang Huang, Haoyi Qiu, Yutong Dai, Caiming Xiong, Chien-Sheng Wu
arXiv Computer Vision
Sep 11

Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding

The paper introduces Caption‑once, Frames‑on‑Demand (CFD), a budget‑aware edge‑cloud framework for long‑video understanding. CFD first runs a single offline captioning pass on the edge to build a dual‑track narrative index—an event‑level story skeleton and a clip‑level micro‑log—that is cached for future queries. At query time, a cloud‑side MLLM uses a Visual‑Need Router to decide whether to retrieve keyframes for perceptual questions, thereby limiting visual processing while preserving temporal structure in language space.

By Weitong Cai, Hang Zhang, Yukai Huang, Yiqiao Xie, Shan Gao, Jiankang Deng, Songcen Xu, Jifei Song, Zhensong Zhang
arXiv Computer Vision
Oct 8

VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding

VideoEvolve is a self‑evolving framework for long‑video understanding that jointly updates both memory and retrieval mechanisms. It starts with a coarse low‑frame‑rate overview and uses a Memory Evolver to selectively augment memory while a Retrieval Evolver adapts how information is fetched from that memory. The two components are alternately refined via Agentic Reinforcement Learning, guided by Bottleneck‑Aware and Capability‑Aware Evolution Feedback to focus on the most limiting aspect and to prevent over‑specialization, respectively. Experiments on several long‑video benchmarks show that this approach improves performance over static systems.

By Yongchao Xu, Bowen Ye, Jiefeng Gan, Junkai Ma, Wenzhao Li, Sen Tao, Yi Wei, Jiawei Liu
arXiv AI
2d ago

RouteDRAG: Learning to Route and Control Agentic Execution for Multimodal Document RAG

RouteDRAG is a learning-based framework for multimodal document retrieval-augmented generation that learns when to invoke an agent and how to control its execution. It comprises a unified document index, adaptive path routing, dynamic agent execution, and sequential policy learning to balance accuracy and computational cost. Experiments on two benchmarks show a 3.47‑point accuracy gain over shorter‑path-only methods while using the agent for only 79.3% of queries, outperforming uniform agent execution with fewer answering calls.

By Zekai Chen, Hao Zhu, Yu Liu, Xunkai Li, Zejian Kang, Rui Qian, Quanjiang Li, Rong-Hua Li
arXiv AI
Jun 30

ManimAgent: Self-Evolving Multimodal Agents for Visual Education

arXiv:2606. 30296v1 Announce Type: new Abstract: Multi-round reflection lets agents built on large language models recover from failures within a single task, but each task remains an isolated episode: lessons learned across many reflection rounds on one task are discarded before the next begins.

By Wenjia Jiang, Zongyuan Cai, Yuanhang Shao, Chenru Wang, Boyan Han, Zhixue Song, Keyu Chen, Shengwei An, Xu Yang, Zhou Yang
arXiv AI
Oct 1

Learning to Route in Visual Space via Multi-Step Embedding Retrieval

The paper introduces VHOP, a data generation framework and benchmark for visual agentic search, and VHOP-Router, an end‑to‑end training pipeline that turns a standard embedding model into an autoregressive multi‑step retriever operating directly in visual latent space. VHOP-Router eliminates the need for intermediate text queries, boosting retrieval accuracy from under 5% to 76.3% and improving task success rates by 52.7% while dramatically reducing token usage and API payloads. The approach generalizes to unseen difficulty levels and realistic test sets, offering an efficient solution that preserves native LLM capabilities.

By Tianyu Chen, Mingyuan Zhou, Jiaxing Wu
arXiv AI
Oct 1

Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning

arXiv:2609.34422v2 Announce Type: replace-cross Abstract: Language-model agents increasingly tackle long-horizon tasks whose interaction histories exceed the model's active context. Recent work has b...

By Lirui Luo, Kelong Mao, Heming Xia, Rongqing Li, Xinwei Yang, Luyu Chen, Kieran Wong, Yudong Guo, Xinrui Wang, Jiayin Zhu, Simiu Gu, Sulong Xu, Cong Fang