arXiv Computer Vision
What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Aug 13
Foresight Without Seeing: Latent Futures for World Action Models
arXiv:2608. 11605v1 Announce Type: new Abstract: World Action Models (WAMs) couple future visual prediction with robot action generation, enabling policies to model how the physical world evolves during interaction.
arXiv AI
Sep 10
WorldAgen: Unified State-Action Prediction with Test-Time World Model Training
WorldAgen is a unified framework that jointly learns world modeling and action prediction using a shared Transformer backbone with two specialized heads. It introduces a Mixed Unidirectional Attention Mask to separate the world model and agent model, and enables Test-Time Training (TTT) by sampling exploratory actions and updating the world model with real state transitions. Experiments on CALVIN and LIBERO show that WorldAgen matches or surpasses state‑of‑the‑art methods, especially when TTT is applied to a few samples.
arXiv Computer Vision
Sep 24
Latent evolving World Action Model
arXiv:2609.27455v1 Announce Type: new Abstract: World Action Models (WAMs) jointly model action generation and environment dynamics and are mostly built on pretrained Video Diffusion Models (VDMs). I...
arXiv Computer Vision
1d ago
CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
CtrlWAM introduces a controllable world action model that jointly predicts actions (intent) and visual futures (foresight). By executing perturbed actions in a simulator and pairing them with noised visual outcomes, it aligns action predictions with their visual consequences, using warped video–action noise schedules to maintain visual layout responsiveness. The model extends beyond ego‑only control to multiple agent streams, improving action forecasts, video–action agreement, and command following in driving and robotics experiments.
arXiv Computer Vision
Sep 22
The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models
arXiv:2609.23369v1 Announce Type: new Abstract: Generation-free world action models (WAMs) retain future-video prediction during training but act from internal video features at inference, leaving un...
arXiv Machine Learning
Jun 9
C$^3$ache: Accelerating World Action Models with Cross Inference Chunk Cache
arXiv:2606. 08962v1 Announce Type: new Abstract: World Action Models (WAMs) generalize better than standard Vision-Language-Action (VLA) policies to novel motions and environments, because a video-modeling objective lets them learn from abundant unlabeled video rather than scarce labeled robot demonstrations.