arXiv Computation and Language
Oct 9

GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness

GUI-KV is a plug‑and‑play key‑value cache compression method designed for graphical user interface agents that use vision‑language models. It exploits spatial saliency and temporal redundancy to prune cache entries, achieving near‑full‑cache accuracy while using modest memory budgets. Experiments on standard GUI agent benchmarks show significant reductions in decoding FLOPs and improvements in step accuracy compared to existing compression baselines.

By Kung-Hsiang Huang, Haoyi Qiu, Yutong Dai, Caiming Xiong, Chien-Sheng Wu
arXiv Computer Vision
Sep 11

Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding

The paper introduces Caption‑once, Frames‑on‑Demand (CFD), a budget‑aware edge‑cloud framework for long‑video understanding. CFD first runs a single offline captioning pass on the edge to build a dual‑track narrative index—an event‑level story skeleton and a clip‑level micro‑log—that is cached for future queries. At query time, a cloud‑side MLLM uses a Visual‑Need Router to decide whether to retrieve keyframes for perceptual questions, thereby limiting visual processing while preserving temporal structure in language space.

By Weitong Cai, Hang Zhang, Yukai Huang, Yiqiao Xie, Shan Gao, Jiankang Deng, Songcen Xu, Jifei Song, Zhensong Zhang
arXiv Computer Vision
Oct 8

VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding

VideoEvolve is a self‑evolving framework for long‑video understanding that jointly updates both memory and retrieval mechanisms. It starts with a coarse low‑frame‑rate overview and uses a Memory Evolver to selectively augment memory while a Retrieval Evolver adapts how information is fetched from that memory. The two components are alternately refined via Agentic Reinforcement Learning, guided by Bottleneck‑Aware and Capability‑Aware Evolution Feedback to focus on the most limiting aspect and to prevent over‑specialization, respectively. Experiments on several long‑video benchmarks show that this approach improves performance over static systems.

By Yongchao Xu, Bowen Ye, Jiefeng Gan, Junkai Ma, Wenzhao Li, Sen Tao, Yi Wei, Jiawei Liu