Elastic-WAM introduces an adaptive spatiotemporal refinement strategy for world-action models, allocating computational effort across time and space based on a learned refinement demand field. This field determines when to stop refinement, how far to advance denoising steps, and which future regions to refresh, enabling efficient recurrent sparse refinement. Experiments on simulation and real‑world long‑horizon manipulation tasks show state‑of‑the‑art control performance with lower inference latency.
By Haitian Li, Tianfu Li, Xuxi Zhao, Zizheng Liu, Yangcheng Yu, Yiwen Hou, Zeyu Xiao, Mutian Xu, Ziqian Yang, Haonan Chen, Lin Shao
arXiv:2609.38984v1 Announce Type: cross
Abstract: World-action models (WAMs) leverage pretrained video models to improve generalization in robot control by jointly predicting future visual states and...
By Xinling Xie, Haodong Wang, Jiazhi Mi, Zhiming Liu, Zicong Hong, Xiaoyi Pang, Qianli Liu, Yangjia Hu, Ying Chen, Zhengyang Yan, Song Guo
The paper introduces FRED, a framework that self‑distills future video representations for World Action Models (WAMs) by predicting these representations from noise using ground‑truth future observations as targets. By conditioning on historical observations, FRED improves the quality of future representations obtained in a single denoising step, thereby enhancing action prediction efficiency. Experiments on real‑world manipulation tasks show that FRED outperforms existing WAMs, especially on long‑horizon, out‑of‑domain, and zero‑shot scenarios, achieving a 50.0% success rate on tasks only seen in human videos versus 19.4% for the best competitor.
By Huiwon Jang, Suhyeok Jang, Hyeonmo Kang, Seungku Kim, Jinwoo Shin, Sihyun Yu
arXiv:2610.33941v1 Announce Type: new
Abstract: World action models have demonstrated promising performance in robot policy learning, yet their high inference latency remains a critical bottleneck fo...
By Guile Wu, Shuangzhi Li, Xingxin Chen, Chengjie Huang, Sam Hosseini, Tongtong Cao, Yingxue Zhang, Dongfeng Bai
The paper introduces Spatially Aware World Action Model (SA‑WAM), a diffusion‑based framework that extends existing World Action Models by incorporating depth information alongside RGB to enable 3‑D‑aware action and future‑state prediction. SA‑WAM repurposes a pretrained video diffusion model, using a nonlinear encoding to map unbounded depth into the tokenizer’s bounded domain, thus preserving pretrained visual priors without 3‑D‑specific fine‑tuning. The model achieves state‑of‑the‑art performance on RoboCasa and LIBERO‑Plus benchmarks and demonstrates superior real‑world performance on a UR5 robotic arm in randomized environments, while also providing analysis linking world‑model prediction quality to rollout success.
By Javier Alejandro Lopetegui Gonzalez, Paul Pacaud, Cordelia Schmid
arXiv:2606. 09811v1 Announce Type: cross Abstract: World-action models have emerged as a promising paradigm for robot manipulation, jointly modeling visual scene dynamics and actions to inject physical priors into policy learning.
By Jisong Cai, Long Ling, Shiwei Chu, Zhongshan Liu, Jiayue Kang, Zhixuan Liang, Wenjie Xu, Yinan Mao, Weinan Zhang, Xiaokang Yang, Ru Ying, Ran Zheng, Yao Mu