MT‑WAM enhances the Fast‑WAM framework by adding complementary supervision for future 2‑D point trajectories and visual features while keeping the original training objectives. A lightweight dual‑stream branch and structured attention mask isolate motion‑specific processing, and motion‑stream tokens provide additional dynamics cues to the action expert. During inference, MT‑WAM skips future‑video prediction, using cached video and motion information to achieve higher success rates on LIBERO, LIBERO‑Plus, RoboTwin 2.0 Clean2Rand, and several real‑world tasks.
By Yiguang Yang, Jiankun Peng, Xiaoming Wang, Yiran Zhang, Zhibo Fang
arXiv:2610.28122v1 Announce Type: cross
Abstract: Cascade world-action models (WAMs) use predicted visual futures to condition robot actions, but inherit costly iterative inference from diffusion-pre...
By Shaoyi Zheng, Zhongtao Jiang, Yue Peng, Wenbo Lu, Shunchi Zhang, Xi Wang, Shengji Wan
WAM-Cache is a training‑free framework that reuses layerwise key‑value (KV) representations from a pretrained video Diffusion Transformer (DiT) across control chunks, recomputing only a sparse set of refreshed tokens. By selecting refresh tokens based on the action expert’s cross‑attention, visual latent surprise, and a strict age bound, it reduces DiT prefill FLOPs by 32‑42% on datasets such as RoboTwin 2.0 and LIBERO while maintaining action accuracy within 0.7‑1.8 percentage points of the dense baseline in simulation and 2.5 points on a real robot.
By Kai Ding, Yang He, Ruijie Quan, Yi Yang
arXiv:2610.06617v2 Announce Type: replace-cross
Abstract: World Action Models (WAMs) incorporate visual representations from video generation backbones to guide action prediction. Recent efficient WA...
By Chengtao Lv, Jinyang Du, Shuyi Feng, Yang Yong, Shiqiao Gu, Shunzi Yang, Ruihao Gong, Shen Ren, Tianwei Zhang, Wenya Wang
UniWALM is a unified world-action-language model that jointly learns video, action, and language in a single shared representation, using a mixture-of-transformers backbone with diffusion heads that co-denoise across modalities. By generating language as part of the same pass as action, the model closes a language‑as‑memory loop without an external planner, and introduces Flow Matching with Correction to maintain reliable action streams. Experiments show UniWALM outperforms baselines on compositional pick‑and‑place tasks and memory‑dependent benchmarks, and dramatically improves success on a real‑world Find‑the‑Item task when using generated textual memory.
By Rahul Sajnani, Diego Romeres, Mingyuan Zhang, Kai Gao, Carl Qi, Baichuan Huang, Srinath Sridhar, Dylan Randle, Lillian J. Ratliff, Jose Barreiros, Manikantan Nambi, Jeroen Vanbaar
arXiv:2610.02508v1 Announce Type: new
Abstract: World action models (WAMs) have emerged as a promising paradigm for robotic control by jointly predicting future visual dynamics and actions from an in...
By Fei Zhang, Zhaochong An, Duncan Frost, Yikai Wang, Pengfei Liu, Ya Zhang, Michal Drozdzal, Amir Bar
Vision‑Language‑Action (VLA) models translate web‑pretrained vision‑language knowledge into robot actions, enabling physical control from online data. This survey examines 88 VLA studies from Dec 2022 to Oct 2026, covering manipulation, navigation, humanoid control, and world‑action models, and evaluates them across seven life‑cycle axes: inputs, architecture, action output, intermediate predictions, pretraining data, post‑training adaptation, and real‑time deployment. Key trends include expanding training data, a split in model sizes (3–7 B vs. <1 B parameters), and the rise of generalist VLAs that handle both manipulation and navigation.
"whyItMatters":"The survey highlights how VLA models are evolving to leverage broader data sources and more efficient architectures, indicating a shift toward scalable, generalist robotic systems that can be trained on consumer hardware and deployed in real‑world settings."
By Suvarna Kadam (Witsense AI), Soran Parsa (University of Huddersfield)
arXiv:2609.38057v1 Announce Type: new
Abstract: Improving robot policies on new tasks without collecting additional expert demonstrations remains a central challenge in robot learning. World action m...
By Shiyang Zhou, Xionghao Wu, Wenbo Li, Shenghe Zheng, Jiyao Zhang, Songsong Yu, Yijun Yang, Jianhui Liu, Haoze Sun, Senqiao Yang, Li Jiang, Jingyong Su, Haoyang Huang, Zhuotao Tian
arXiv:2609.36471v1 Announce Type: cross
Abstract: World-Action Models (WAMs) improve robotic manipulation by conditioning action generation on predicted future observations, but future prediction add...
By Guoheng Sun, Chen Chen, Jin Wang, Ang Li, Teresa Lv
World Action Models (WAMs) are able to leverage pretrained video generators for both world modeling and action prediction. However, directly leveraging such video generators for control raises a new challenge: how to represent actions in a suitable form that aligns with pretrained video generators while carrying enough motion cues for accurate control.
La‑JEPA introduces a compact world‑action model that trains a policy transformer from scratch in the feature space of a pretrained V‑JEPA encoder, learning to predict future features jointly with actions during training but generating only actions at inference. The approach achieves state‑of‑the‑art performance on RoboTwin 2.0 and LIBERO‑Plus while using far fewer parameters and running faster than comparable methods such as Fast‑WAM, LeapBot‑WA, and JEPA‑WAM. A design study shows that JEPA features outperform video VAE latents, especially out‑of‑distribution, and that training‑time future‑prediction choices significantly influence policy performance even when future prediction is omitted at inference.
By Mateo Cl\'emente, George Z. Xue, Amin Abyaneh, Liheng Ma, Rui Heng Yang, Tongtong Cao, Zhanguang Zhang, Yingxue Zhang
InternW0-Δ is a unified World Action Model that integrates pretrained visual dynamics, scene semantics, 4D geometry, and motion priors within a Mixture-of-Transformers framework to generate robot actions. It leverages a frozen VLM for semantic guidance, a 4D foundation model for geometric priors, and introduces Causal Imprint to learn future-relevant scene changes without future-video rollout. The model is pretrained on a newly curated 20K‑hour heterogeneous corpus of robot and human demonstrations, achieving superior performance on simulation benchmarks and real‑robot platforms.
By Xingyu Miao, Zizun Li, Baole Fang, Kaiwen Song, Tenghui Wang, Hanxue Zhang, Yating Wang, Xudong Li, Yuping He, Xueyuan Wei, Chao Gao, Xijie Yang, Yingxiang Xu, Kerui Ren, Wenqi Guo, Jianjun Zhou, Xinzhe Wang, Weiguang Zhao, Ni Yang, Zetao Cai, Yufei Xue, Hengjie Li, Zeyu He, Yuanzhen Zhou, Rong Fu, Jianyang Zhang, Siwei Cui, Fuxian Huang, Yunsong Zhou, Xing Gao, Yifei Yao, Qiaojun Yu, Kailin Li, Ming Zhou, Mu Huang, Xinyue Li, Wenze Cui, Bingqi Jiang, Xueyue Zhu, Junting Dong, Haoyu Guo, Tao Lu, Mulin Yu, Bowen Zhou, Bin Zhao, Tianfan Xue, Weinan Zhang, Chunhua Shen