ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2609.10297v1 Announce Type: new Abstract: GUI agents accumulate high-resolution screenshots as the trajectory unfolds, increasing inference latency and memory usage. Training-free visual token...
arXiv:2608.29897v1 Announce Type: new Abstract: Long-horizon agents need a context manager to compress growing interaction histories into a bounded working context, via passive strategies or active s...
GUI-KV is a plug‑and‑play key‑value cache compression method designed for graphical user interface agents that use vision‑language models. It exploits spatial saliency and temporal redundancy to prune cache entries, achieving near‑full‑cache accuracy while using modest memory budgets. Experiments on standard GUI agent benchmarks show significant reductions in decoding FLOPs and improvements in step accuracy compared to existing compression baselines.
GUIFlow is a framework that enables temporal redundancy‑aware incremental inference for GUI agents built on vision‑language models. By selectively updating computational states—such as position‑aligned KV states, vision encoder outputs, and language model drafts—across interaction steps, it allows cross‑step reuse of visual encoding, prefill, and decoding without extra training or model changes. Experiments show up to 3.39× speedup on offline benchmarks and 3.49× in online OSWorld interactions while preserving task performance.
arXiv:2608. 02352v1 Announce Type: new Abstract: Native computer use offers a general interface for agents to operate almost any software available to people, but requires long-horizon state tracking, large-scale interactive experience, and learning from sparse yet verifiable outcomes.
arXiv:2610.20390v1 Announce Type: new Abstract: With the rapid development of vision-language models (VLMs), Web-GUI agents have achieved promising performance in interacting with real-world interfac...