arXiv AI
TOAST: Stochastic Robot Action Tokenization for Autoregressive Vision-Language-Action Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jul 27
Ordered Action Tokens for Visuomotor Policy Learning
arXiv:2607. 21670v1 Announce Type: cross Abstract: Action tokenization maps continuous robot action chunks to discrete tokens and has become an important interface for modern visuomotor policies.
arXiv AI
Sep 17
ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models
ActionPiece rethinks how actions are tokenized for autoregressive vision‑language‑action models by introducing physical rank consistency (PRC) to evaluate relational fidelity of reconstructed actions. The method jointly supervises representation learning and quantization to preserve local physical distance rankings, improving both PRC and policy success. Experiments on LIBERO, LIBERO‑Plus, SimplerEnv, and VLA‑Arena show significant gains over baseline tokenizers.
arXiv AI
Aug 12
Lost in Reconstruction: Aligning Action Representations with Language in Vision-Language-Action Models
arXiv:2608. 10484v1 Announce Type: cross Abstract: Action verbs describe not only the physical outcomes of actions, but also how those actions are performed.
arXiv AI
Jun 30
SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performance
arXiv:2606. 30113v1 Announce Type: cross Abstract: Discrete action tokenization provides a compact interface for autoregressive VLA policies, but accurately recovering continuous robot actions from discrete codes remains challenging.
arXiv AI
Jun 16
X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining
arXiv:2606. 14752v1 Announce Type: cross Abstract: Modern Vision-Language-Action (VLA) models must bridge pretrained vision-language reasoning and precise continuous robot control.
arXiv Machine Learning
Jul 31
CLAM: Continuous Latent Action Models for Robot Learning from Unlabeled Demonstrations
arXiv:2505. 04999v2 Announce Type: replace-cross Abstract: Learning robot control policies from demonstrations typically requires action-labeled expert data, which is expensive to collect through teleoperation.