StateCraft introduces a new architecture that separates a persistent, updatable abstract state from the visual state in video world models. By pairing a language model with a video diffusion model, it tracks entity changes over time and conditions visual generation on this abstract state. The approach is evaluated on generative interfaces and a new benchmark, showing improved generation quality, memory usage, and controllability, while enabling direct editing of unseen states and extending to spatial 3D environments.
By Lorenzo Venturoli, Nedko Savov, Xi Wang, Marc Pollefeys, Luc Van Gool
arXiv:2607. 17523v1 Announce Type: cross Abstract: Recent advances in world models and video generation have given rise to an emerging reasoning paradigm that leverages video generative models to simulate, predict, and reason about real-world dynamics.
By Yongheng Zhang, Guang Yang, Ruihan Hou, Qiguang Chen, Ziang Liu, Xiaolong Liu, Manman Zhang, Yanchao Hao, Zheng Wei, Hao Wu, Libo Qin, Peishan Dai, Yinghui Li, Di Yin, Xing Sun
The paper introduces Code World Model, a framework that decouples world evolution from visual rendering by using a coding agent as a world brain. The agent reasons about events, generates executable code to maintain persistent state, and a proxy representation links this state to a video model for high‑fidelity visual output. Experiments with MiniMax‑H3 show that the system can follow proxy‑based spatiotemporal specifications while preserving rich visual dynamics, illustrating a new approach to open‑ended world modeling.
By Yiwen Chen, Guosheng Lin, Chi Zhang
arXiv:2511.17481v2 Announce Type: replace
Abstract: World models learn to predict the temporal evolution of visual observations given a control signal, potentially enabling agents to reason about env...
By Yiqing Shen, Aiza Maksutova, Chenjia Li, Mathias Unberath
Oneira is an interactive video world model that links open-ended generation with persistent interaction. It uses a coding agent to manage an extensible world state, allowing newly generated or discovered entities to become actionable and ensuring that changes made by an agent are retained across video segments. Experiments demonstrate that Oneira supports consistent interaction with new objects while preserving prior interaction effects over long horizons.
By Xindi Yang, Baolu Li, Liam Lee, Zhenfei Yin, Songxin Zhang, Zhuoyang Song, Xu Jia, Jianfei Cai, Tien-Tsin Wong, Bingyi Jing, Mengyue Yang
World Observer introduces a joint actor‑observer framework for persistent world modeling, decoupling the agent’s view from panoramic observers that track regions outside the actor’s field of view. By warping from a shared panoramic source and using an Observer Sink for high‑resolution references, the method maintains accurate object states and dynamics even when they leave and re‑enter the actor’s view. The approach is evaluated with new world‑space metrics and a benchmark across real and synthetic scenes, showing improved out‑of‑view dynamics while preserving visual fidelity, camera control, and 3D adherence.
By Hyunwook Choi, Dahyun Chung, Hyunsung Kim, Siyoon Jin, Jinhyeok Choi, Junyoung Seo, Seungryong Kim