arXiv AI By Tengda Guo (Tsinghua University), Jiawang Hu (StepFun), Yifei Tao (Nanyang Technological University), Yin Wang (StepFun), Haotian Hu (Zhejiang Leapmotor Technology Co., Ltd), Fanyi Wang (Honor), Liujuan Tang (StepFun)

ECHOES: Seeing Beyond the Current Image via Recursive History Compression and Privileged On-Policy Distillation

Read the original on arXiv AI →

ECHOES is a method for long‑horizon GUI agents that compresses visual history into a textual state using a Compression‑Think‑Action format. It employs a privileged teacher model that provides token‑level on‑policy distillation to guide the student’s textual rollouts, while a Perception‑Memory Fidelity Gap‑guided framework balances distillation with task reward optimization. The approach is evaluated on four GUI benchmarks and a new ECHOESBMK diagnostic benchmark, showing improved task performance, memory fidelity, and a favorable trade‑off between performance and inference cost, with positive zero‑shot transfer to unseen planning tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 30

EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies

arXiv:2606.20092v3 Announce Type: replace Abstract: Memory remains a critical bottleneck for long-horizon robotic manipulation, as standard Vision-Language-Action (VLA) policies often fail when task-...

By Ganlin Yang, Zhangzheng Tu, Yuqiang Yang, Sitong Mao, Junyi Dong, Tianxing Chen, Jiaqi Peng, Jing Xiong, Jiafei Cao, Jifeng Dai, Wengang Zhou, Yao Mu, Tai Wang
arXiv Computation and Language
Oct 9

GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness

GUI-KV is a plug‑and‑play key‑value cache compression method designed for graphical user interface agents that use vision‑language models. It exploits spatial saliency and temporal redundancy to prune cache entries, achieving near‑full‑cache accuracy while using modest memory budgets. Experiments on standard GUI agent benchmarks show significant reductions in decoding FLOPs and improvements in step accuracy compared to existing compression baselines.

By Kung-Hsiang Huang, Haoyi Qiu, Yutong Dai, Caiming Xiong, Chien-Sheng Wu
arXiv AI
4d ago

COMET: Decoupled Distillation, Routing, and Capacity Control for Task-Agnostic Continual Vision--Language Learning

COMET is a task‑agnostic continual learning framework for vision‑language models that addresses modal‑consistency drift, representation‑space interference, and per‑task capacity shortfall. It uses a frozen teacher for feature reference, Tri‑Affinity Distillation to preserve image‑image, text‑text, and image‑text geometry, and Student‑Aware Cross‑Expert Distillation to align new experts with prior ones, while a contextual bandit and reconstruction router manage capacity and inference. Experiments on the X‑TAIL benchmark show that each component improves continual learning performance, demonstrating that separating feature reference, expert shaping, routing, and capacity control enables effective multimodal adaptation.

By Seungyoon Woo, Keonhee Park, Gunhee Kim