Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2609.05588v3 Announce Type: replace-cross Abstract: World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled inte...
arXiv:2610.16443v1 Announce Type: new Abstract: Recent world action models draw on video generation priors to jointly predict future observations and robot actions. Adapting these priors to control r...
arXiv:2609.38059v1 Announce Type: cross Abstract: Real-world robot learning is constrained by the cost of collecting experience and evaluating candidate behaviors. Video generation models offer a sca...
arXiv:2611.17626v1 Announce Type: new Abstract: Joint world action models (WAMs) generate future actions and states together, modeling world-action trajectories rather than actions alone. However, tr...
arXiv:2609.27455v1 Announce Type: new Abstract: World Action Models (WAMs) jointly model action generation and environment dynamics and are mostly built on pretrained Video Diffusion Models (VDMs). I...
WorldOracle is a benchmark that evaluates action‑conditioned world models (ACWMs) by comparing their predicted rollouts to paired real‑world executions. It assesses models across four dimensions—physical state correctness, spatial alignment, key interaction fidelity, and multi‑view coherence—using curated training and evaluation suites that include long, multi‑segment episodes with both successful and failed actions. Experiments on seven ACWMs highlight distinct strengths and failure modes, providing a systematic foundation for advancing manipulation modeling.