arXiv:2610.34663v1 Announce Type: cross
Abstract: Video world models trained on large-scale robot data promise a safe and scalable approach for learning and evaluating policies that act in the physic...
By Mattia Scardecchia, Sherry Yang
StarWM introduces a self‑supervised attention routing mechanism that selectively applies reconstruction only to dynamically relevant regions of visual input. By combining a cross‑attention module with a dual‑stream decoder and stop‑gradient barriers, it balances faithful environmental dynamics capture with abstraction of irrelevant content. Experiments on DeepMind Control show that StarWM outperforms both reconstruction‑based and reconstruction‑free baselines, especially under distractor conditions, and preserves state attributes over long‑horizon imagination.
By Zeqiang Zhang, Fabian Wurzberger, Maximilian Otte, Daniel Schmid, Sebastian Gottwald, Arne Peter Raulf, Daniel Alexander Braun
arXiv:2610.14228v1 Announce Type: cross
Abstract: Pixel-space world models have recently emerged as a promising approach for GUI agents, predicting future screens prior to execution and subsequently...
By Seungjun Yu, Hojun Choi, Seojeong Park, Jaeyo Shin, Hyunjung Shim
MAC‑v2 is a new framework for long‑horizon model‑based value expansion from pixel observations in offline reinforcement learning. It trains a reconstruction‑free latent world model that learns representations through prediction and control objectives, avoiding the need to encode control‑irrelevant visual details. By using action chunking, MAC‑v2 reduces recursive model predictions, mitigating error accumulation and achieving strong performance on visual benchmarks such as OGBench, MMBench2, Robomimic, and LIBERO‑10.
By Kwanyoung Park, Sergey Levine
The paper introduces motion-guided contrastive regularization to improve JEPA-style world models by preventing static collapse, where encoders overemphasize episode-specific static content. By comparing predicted latent transitions with transitions to candidate observations within the same episode and using optical-flow similarities as soft contrastive targets, the method encourages representations that preserve manipulation-relevant state changes. Experiments on OGBench-Cube and LIBERO-Object show significant gains in planning success while maintaining performance on other visual-control benchmarks.
By Yiwen Chen, Qiqi Hou, Jisoo Jeong, Yinhao Zhu, Huaizu Jiang, Amir Said
JEPA-style world models learn action-conditioned latent dynamics without reconstructing observations, but distributional regularization alone does not ensure that their representations preserve inform...