arXiv AI
Vision-Language Models Are Joint Denoisers in Robotic Action Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Oct 21
De-Diffusing WAMs: Action-Sufficient Direct Prediction for Robot Control
arXiv:2610.28122v1 Announce Type: cross Abstract: Cascade world-action models (WAMs) use predicted visual futures to condition robot actions, but inherit costly iterative inference from diffusion-pre...
Hugging Face Trending Papers
Jun 4
Let It Be Simple: One-Step Action Generation for Vision-Language-Action Models
Diffusion-based vision-language-action (VLA) models often inherit the image-generation view: actions are generated by iterative denoising. We argue that VLA action generation has a different condition-target structure: the policy is conditioned on rich observations, language, and state, but predicts only a compact, low-dimensional action chunk.
arXiv AI
Aug 13
G0.5: One Autoregressive Stream for Robot Reasoning and Action
arXiv:2608. 11739v1 Announce Type: cross Abstract: The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert.
arXiv Computer Vision
Oct 19
MambaAct: Efficient Mamba Action Experts for Flow-Matching Vision-Language-Action Models
MambaAct introduces a compact Mamba-based action expert to replace the transformer-based expert in flow‑matching vision‑language‑action models, preserving the pretrained visual‑language prefix encoder while reducing the action expert size by tenfold. The new design employs a lightweight Context Compressor to embed vision‑language conditioning into each Mamba block, eliminating repeated token‑level cross‑attention. Experiments show a 64.8 % reduction in denoising latency on LIBERO and 58.8 % in real‑world deployment, with a modest 1.08 % increase in mean success rate across multiple fine‑tuning seeds.
arXiv Machine Learning
Jun 5
Let It Be Simple: One-Step Action Generation for Vision-Language-Action Models
arXiv:2606. 05737v1 Announce Type: cross Abstract: Diffusion-based vision-language-action (VLA) models often inherit the image-generation view: actions are generated by iterative denoising.
arXiv AI
Aug 25
Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models
The paper introduces Intention Distillation (INDI), a method that injects behavior-level intent into Vision‑Language‑Action (VLA) model decoders by leveraging a frozen teacher vision‑language model to interpret demonstrations. During training, the teacher processes the current observation, instruction, coarse action summary, and execution video, producing a multimodal intent representation that the VLA decoder uses alongside trajectory and execution features to predict actions. Experiments on SimplerEnv‑Bridge, RoboCasa Kitchen, and real‑world tasks show that INDI consistently improves success rates, especially on longer‑horizon tasks, demonstrating that explicit modeling of semantic intent benefits action decoders.