arXiv Computer Vision
VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Jun 30
SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performance
arXiv:2606. 30113v1 Announce Type: cross Abstract: Discrete action tokenization provides a compact interface for autoregressive VLA policies, but accurately recovering continuous robot actions from discrete codes remains challenging.
arXiv AI
3d ago
ActionCodec: What Makes for Good Action Tokenizers
The paper "ActionCodec: What Makes for Good Action Tokenizers" addresses the lack of design guidance for action tokenization in Vision‑Language‑Action (VLA) models. By deriving information‑theoretic principles—maximizing temporal token overlap, reducing vocabulary redundancy, boosting multimodal mutual information, and ensuring token independence—the authors propose ActionCodec, a tokenizer that improves training efficiency and VLA performance. Experiments show that a SmolVLM2‑2.2B fine‑tuned with ActionCodec reaches a 95.5 % success rate on LIBERO, rising to 97.4 % with architectural tweaks, setting a new state‑of‑the‑art for VLA models without robotics pre‑training.
arXiv AI
Jun 19
Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
arXiv:2606. 20246v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models pre-trained on massive video-robot datasets have revolutionized robotic manipulation, yet their multi-billion parameter architectures impose prohibitive computational burdens during downstream fine-tuning and real-time inference.
arXiv Machine Learning
Jun 16
AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
arXiv:2511. 18960v4 Announce Type: replace Abstract: Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep.
arXiv AI
Aug 19
LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models
LoopVLA introduces a recurrent Vision‑Language‑Action architecture that learns to refine multimodal representations, predict actions, and estimate when further refinement is unnecessary. By iteratively applying a shared Transformer block and producing a sufficiency score at each step, it decouples refinement from fixed layer indices and aligns confidence scores with action quality through a self‑supervised objective. Experiments on LIBERO, LIBERO‑Plus, and VLA‑Arena demonstrate that LoopVLA reduces model parameters by 45% and boosts inference throughput up to 1.7× while matching or surpassing strong baselines in task success.
arXiv Computer Vision
Aug 27
Training-Free Interaction-Aligned Visual Token Pruning for Efficient Embodied Manipulation
The paper introduces Interaction‑Aligned Pruning (IAprune), a training‑free method for visual token pruning in embodied manipulation tasks. IAprune jointly decides per‑frame budget and token selection, using semantic‑motion spatial agreement to choose between conservative and aggressive coverage, and applies geometric residual correction to focus on under‑represented boundaries. Experiments on four policies, three simulation benchmarks, and a real‑robot platform show that IAprune matches unpruned performance on LIBERO while achieving up to 1.54× speed‑up and 1.48× acceleration on a real robot.