arXiv AI By Xiaoyang Xing, Chun-Mei Feng, Anthony Cohn, Xiaoliang Gong, Asoke Nandi

APS-VLA: Action-Guided and Future-Aware Token Pruning for Efficient Vision-Language-Action Models

Read the original on arXiv AI →

APS‑VLA is a framework that learns to prune visual tokens for vision‑language‑action models by training a Decision Influence Estimator on robot demonstrations while keeping the VLA backbone frozen. The estimator scores tokens based on current visual observations, language instructions, and robot proprioception, using action supervision and an auxiliary visual transition objective during training. At inference, a single hard selection and packing step reduces policy inference latency from 137.25 ms to 93.25 ms, achieving a 1.47× speedup with only a modest change in task success.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 12

Beyond Actions: Learning Future Operation Targets for Vision-Language-Action Models

The paper introduces Action–Future Coupled Effect Learning (AFCE), a method that shifts the primary prediction target of vision‑language‑action (VLA) policies from action chunks to future‑grounded physical Effects. AFCE constructs temporally ordered Effect tokens from demonstrations, robot responses, and visual transitions, and uses reconstruction objectives to preserve executable detail and physical change. On the DexJoCo benchmark, AFCE achieves a 50.97% overall success rate, outperforming baseline policies by 11.82 and 15.21 percentage points and excelling on all five bimanual tasks, underscoring the benefit of Effect supervision for coordinated dexterous manipulation.

By Min Lin, Bokai Zhou, Jianqi Lin, Kaiyuan Yang, Yicheng Chang, Junjie Yu, Xiaofan Liu, Jianhua Han, Rui Li, Shen Zhao, Xiaodan Liang
arXiv Machine Learning
Jun 16

AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention

arXiv:2511. 18960v4 Announce Type: replace Abstract: Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep.

By Lei Xiao, Jifeng Li, Juntao Gao, Feiyang Ye, Yan Jin, Jingjing Qian, Jing Zhang, Yong Wu, Xiaoyuan Yu
arXiv AI
Sep 18

HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface

HIL-UMI is a policy-guided Universal Manipulation Interface that enables robot‑free, human‑in‑the‑loop post‑training of vision‑language‑action models. By querying the current policy during handheld demonstrations and using an Energy Score to detect out‑of‑distribution states, it selectively collects new data and refines a progress‑based advantage estimator. The updated estimator then drives advantage‑conditioned behavioral cloning, improving performance on long‑horizon and precise manipulation tasks while reducing per‑frame collection time compared to HG‑DAgger.

By Zimu Han, Yiming Zeng, Jiyao Zhang, Zihao Zhao, Yuanfei Wang, Yixiang Jin, Shiqi Li, Shuangben Chen, Wei Huang, Ruodai Li, Hui Shen, Hao Dong
arXiv Computer Vision
Nov 6

T3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models

T3R is a training‑free, two‑stage token refinement framework designed to improve the efficiency and robustness of Vision‑Language‑Action (VLA) models. The first stage uses segmentation‑guided pruning to remove irrelevant visual patches, while the second stage applies saliency‑guided attention biasing to focus on action‑critical regions and language cues. Experiments on LIBERO‑Spatial, LIBERO, SIMPLER, and RoboTwin show that T3R can eliminate 85% of visual tokens with minimal loss in success rate and even improve performance under distribution shifts, achieving up to a 3.3× speedup in large‑scale settings.

By Mohammed Hassan (Celine), Zhenyang Chen (Celine), Zheng Wang (Celine), Zhixin Zhu (Celine), Tianlong Chen (Celine), Yingyan (Celine), Lin, Chaojian Li