arXiv AI By Zhiguang Liu, Yi Shang

RoSeViT: Role-Separated Vision Transformers for ARC Visual Reasoning

Read the original on arXiv AI →

RoSeViT introduces a role-separated Vision Transformer that decouples high-level instruction inference from visual workspace computation using controller and workspace tokens. This design allows nonlocal workspace interactions to be routed through the controller, reducing complexity compared to dense ViTs. Empirical results show RoSeViT improves ARC-1 accuracy from 54.5 to 56.6 with a backbone replacement and up to 62.6 when integrated into the full system.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 15

Visual Access Boundaries in Vision-Language Model Reasoning

arXiv:2607. 12815v1 Announce Type: new Abstract: Chain-of-Thought (CoT) prompting is widely used as a test-time scaling strategy for Vision-Language Models (VLMs), but it remains unclear what is extended when VLMs generate longer reasoning traces.

By Hiroto Osaka, Shohei Taniguchi, Gouki Minegishi, Kai Yamashita, Masahiro Suzuki, Yutaka Matsuo
arXiv Computer Vision
1d ago

T3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models

T3R is a training‑free, two‑stage token refinement framework designed to improve the efficiency and robustness of Vision‑Language‑Action (VLA) models. The first stage uses segmentation‑guided pruning to remove irrelevant visual patches, while the second stage applies saliency‑guided attention biasing to focus on action‑critical regions and language cues. Experiments on LIBERO‑Spatial, LIBERO, SIMPLER, and RoboTwin show that T3R can eliminate 85% of visual tokens with minimal loss in success rate and even improve performance under distribution shifts, achieving up to a 3.3× speedup in large‑scale settings.

By Mohammed Hassan (Celine), Zhenyang Chen (Celine), Zheng Wang (Celine), Zhixin Zhu (Celine), Tianlong Chen (Celine), Yingyan (Celine), Lin, Chaojian Li