arXiv Computer Vision
Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Oct 9
DreamTrue: Action-Faithful Robot World Model with Counterfactual Post-Training
DreamTrue is a multi‑view, cross‑embodiment robot world model that predicts physically plausible videos while faithfully following actions. It overcomes calibration and limited interaction coverage issues by rendering action trajectories into image‑space conditions, applying offline geometric calibration, and using counterfactual post‑training to generate a broader range of future videos. A human‑annotated defect dataset trains a video reward model that guides reinforcement‑learning post‑training, resulting in state‑of‑the‑art action following on AgiBot and a significant drop in interaction defect rates.
arXiv Computer Vision
Sep 17
StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
arXiv:2609.18430v1 Announce Type: new Abstract: Modeling physical dynamics, including how objects move, interact, and change state, is central to video world models for embodied AI. We present StrucP...
arXiv AI
Aug 27
DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
DELE-w0.5 is a robotic manipulation framework that predicts future latent states instead of generating full video sequences, thereby inferring robot actions directly from these compact representations. By focusing on physical state changes rather than visual transitions, it reduces model complexity and inference latency. In 480 real‑robot trials across four long‑horizon tasks, DELE‑w0.5 achieved 62.5 % overall task success and 81.3 % macro ordered‑stage progress, outperforming the strongest baseline by 47.5 and 30.7 percentage points.
arXiv AI
Jun 30
WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL
arXiv:2602. 13977v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) promises to unlock capabilities beyond imitation learning for Vision--Language--Action (VLA) models, but its requirement for massive real-world interaction prevents direct deployment on physical robots.
arXiv Computer Vision
Sep 16
World-Action Models for Robot Learning and Control: A Survey
The survey "World-Action Models for Robot Learning and Control" reviews recent advances in coupling future world prediction with executable action generation for robots in open environments. It clarifies the scope of World-Action Models (WAMs) relative to conventional world models, model-based RL, and Vision‑Language‑Action policies, and organizes existing methods through a unified taxonomy covering representations, transition modeling, action interfaces, architectures, training pipelines, data modalities, and scaling strategies. The paper also surveys applications in manipulation, navigation, and autonomous driving, summarizes datasets, benchmarks, and metrics, and discusses key challenges such as action alignment, spatial consistency, long‑horizon memory, and efficient inference.
arXiv AI
Jul 2
From World Models to World Action Models: A Concise Tutorial for Robotics
arXiv:2607. 00836v1 Announce Type: cross Abstract: World models are increasingly used in embodied intelligence and generative simulation, yet their scope remains ambiguous across communities.