World Observer introduces a joint actor‑observer framework for persistent world modeling, decoupling the agent’s view from panoramic observers that track regions outside the actor’s field of view. By warping from a shared panoramic source and using an Observer Sink for high‑resolution references, the method maintains accurate object states and dynamics even when they leave and re‑enter the actor’s view. The approach is evaluated with new world‑space metrics and a benchmark across real and synthetic scenes, showing improved out‑of‑view dynamics while preserving visual fidelity, camera control, and 3D adherence.
By Hyunwook Choi, Dahyun Chung, Hyunsung Kim, Siyoon Jin, Jinhyeok Choi, Junyoung Seo, Seungryong Kim
World in World introduces a training‑free, inference‑time interface that transforms diverse control signals—such as source‑video observations, target‑view projections, geometry renderings, and retrieved states—into camera‑ and time‑labelled visual states. These states are processed by a frozen causal video model’s self‑attention, enabling tasks like camera‑controlled rerendering, long‑horizon revisiting, and human‑motion transfer without additional training. The method employs a correspondence router and evidence‑wise attention to align token identities and regulate auxiliary channel contributions during a single denoising pass.
By Chenxi Song, Yanming Yang, Chi Zhang
World in World introduces a training‑free inference interface that lets users control autoregressive video world models from new viewpoints. By converting diverse control signals—source‑video observations, target‑view projections, geometry renderings, and retrieved states—into camera‑ and time‑labelled visual tokens, the system uses a frozen causal video model’s self‑attention to maintain synchronization, complete unseen regions, and recover past appearances. The method supports camera‑controlled rerendering, long‑horizon revisiting, and human‑motion transfer while preserving perceptual quality, temporal consistency, and camera‑following accuracy.
arXiv:2610.17434v1 Announce Type: cross
Abstract: Recent advances in video world models have enabled plausible interactive environments, yet long-horizon generation places a fundamental demand on vis...
By Junyi Wu, Zekun Li, Chenhongyi Yang, Chen Guo, Lingchen Yang, Yongan Zhang, Xinyi Zhang, Hongbing Hu, Bartek Rymkowski, Srinath Sridhar, Yan Yan, Xijie Huang
arXiv:2610.23856v1 Announce Type: new
Abstract: Generated videos often lose geometric consistency under camera motion: structures warp under viewpoint change, parallax becomes inconsistent, and smoot...
By Weijie Lyu, Tiancheng Shen, Jason Li, Yujing Wang, Xiaoyuan Wang, Haobo Yuan, Yizhou Zhao, Ming-Hsuan Yang
The paper introduces Learning-to-Retrieve (L2R), a method that embeds memory retrieval directly into video world models. By using the model’s internal state as a memory and employing a camera‑conditioned retrieval gate and a retrieval trigger supervised by a 3D re‑visibility signal, the approach learns when and what historical information to access. This eliminates the need for external memory systems and improves long‑term scene consistency across various base models and camera‑revisit benchmarks.
By JiaKui Hu, Tailai Chen, Yuqi Pan, Xuerui Qiu, Jialun Liu, Xiao Cao, Zhenxin Zhu, Guang Chen, Hangjun Ye, Bing Wang, Yanye Lu
arXiv:2605.25333v3 Announce Type: replace
Abstract: Video world models should maintain evolving states when evidence is unobserved, yet current generators often freeze hidden states upon interruption...
By Tianshuo Xu, Yichen Xie, Depu Meng, Chensheng Peng, Quentin Herau, Bo Jiang, Yihan Hu, Wei Zhan
arXiv:2610.19063v1 Announce Type: new
Abstract: As video models enable longer and more realistic interactive experiences, maintaining a world consistent with its history becomes essential. This requi...
By Nan Zhou, Jianxiong Gao, Qiuyu Wang, Wen Wang, Jiahao Wang, Yufeng Yuan, Shuaiting Li, Hao Ouyang, Yujun Shen, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen
WorldCraft is an autoregressive video world model that enables both camera navigation and persistent object-trajectory control in interactive video environments. It introduces Normalized World Trajectory (NWT) to anchor user-specified 2D motion paths in a world coordinate system, and Trajectory-Anchored State Persistence (TASP) to maintain updated object states even when the target is temporarily invisible. The model also employs a pathway-selective LoRA to add object control while preserving pretrained camera navigation capabilities, achieving accurate composable control and maintaining object states across extended off-screen intervals.
By Bohai Gu, Taiyi Wu, Yueyang Yuan, Jian Liu, Xiaocheng Lu, Dazhao Du, Jie Zhang, Jinxiang Lai, Shuai Yang, Xiaotong Zhao, Alan Zhao, Song Guo
DynaTokens introduces lightweight, scene‑specific tokens that enable camera‑controlled video models to learn and generate dynamic scene motion while keeping the base model frozen. By leveraging cross‑attention, the tokens are trained from a few example trajectories, allowing the model to handle both camera‑induced motion and localized object dynamics. Experiments on VBench2 and WorldScore show that DynaTokens outperforms LoRA, block finetuning, and other trainable‑layer baselines in balancing dynamics and camera control.
arXiv:2609.14462v1 Announce Type: new
Abstract: Interactive video world models must maintain broad scene context under camera motion while producing high-fidelity observations with low latency. Exist...
By Jiaming Tan, Mingliang Zhai, Zhen Li, Yuwei Wu, Chuanhao Li, Kaipeng Zhang
arXiv:2606. 02753v1 Announce Type: cross Abstract: Video world models are a foundational generative technology for embodied AI and the Metaverse, yet existing approaches are inherently limited to a single agent observing from a single perspective.
By Teng Hu, Mingchun Lu, Yating Wang, Jiangning Zhang, Jinkun Hao, Ye Pan, Ran Yi, Lizhuang Ma, Dacheng Tao