MambaAct introduces a compact Mamba-based action expert to replace the transformer-based expert in flow‑matching vision‑language‑action models, preserving the pretrained visual‑language prefix encoder while reducing the action expert size by tenfold. The new design employs a lightweight Context Compressor to embed vision‑language conditioning into each Mamba block, eliminating repeated token‑level cross‑attention. Experiments show a 64.8 % reduction in denoising latency on LIBERO and 58.8 % in real‑world deployment, with a modest 1.08 % increase in mean success rate across multiple fine‑tuning seeds.
By Khuyen Pham, Tran Nguyen Le, Edoardo Fazzari, Cesare Stefanini
arXiv:2609.21216v1 Announce Type: cross
Abstract: Vision-language-action (VLA) policies based on flow matching generate action chunks through repeated evaluations of an action expert. Increasing the...
By Zhipeng Tang, Xinda Chen, Weining Rao, Xiao Li, Wenting Tan, Yuning Wang, Xiao Shi, Xiaofang Zhao
arXiv:2608. 11739v1 Announce Type: cross Abstract: The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert.
By Yicheng Liu, Zibin Dong, Baijun Ye, Tianyuan Yuan, Tao Jiang, Anqi Yang, Shicheng Cao, Haonan Liu, Yue Sun, Zihan Guo, Xiao Liu, Dong Ke, Changxun Pan, Chenru Wu, Tailai Cheng, Xiaoshu Ren, Xinlei Zhang, Jianning Cui, Zijie Zhao, Haoyu Zhang, Kaiming Xu, Haodong Yang, Bowen Zhang, Jiahui Niu, Shaoting Zhu, Shiduo Zhang, Hang Zhao
TOPS (Task‑Oriented Priors and Schedules) adapts flow‑based policies for language‑conditioned multi‑task robot manipulation by customizing the flow source prior and interpolation schedule per task without changing the network architecture. It constructs multimodal task sources from reverse‑mapped expert action sequences, allowing language instructions to select the generation start point, and adjusts the denoising schedule based on source‑target covariance mismatch to reduce velocity‑prediction risk. Experiments on LIBERO, LIBERO‑Plus, CALVIN, and real‑world tasks show significant performance gains, including a jump from 53.44 % to 69.67 % success on LIBERO‑10 with a single integration step and a five‑fold reduction in inference time.
By Tuo An, Chuhao Zhou, Jiahua Dong, Jingliang Li, Jiaqi Bai, Jindou Jia, Jianfei Yang
Vision‑Language Models Are Joint Denoisers in Robotic Action Generation introduces JADE, a Joint Action DEnoiser that lets a pretrained vision‑language model (VLM) and a diffusion action expert jointly refine actions. By structuring action latents, the VLM can read noisy actions alongside visual observations and language instructions, guiding the action expert through gated cross‑attention at each denoising step. This joint denoising reduces sampling steps, balances performance and latency, and improves success rates on RoboDojo and RoboTwin 2.0 compared to prior methods.
By Xicheng Gong, Wenxuan Song, Chengze Liu, Qiwei Li, Qize Yu, Jiaolong Yang, Haoang Li, Yadong Mu
arXiv:2610.08183v1 Announce Type: cross
Abstract: Multi-task manipulation policies differ in architecture, scale, and pretrained priors all at once, so published comparisons cannot attribute performa...
By Nanhe Chen, Runqiu Yang, Jiawei Tang, Sichao Liu, Yuquan Wang