arXiv Computer Vision

Orbia: Do Generated Videos Form a Consistent 3D World?

Orbia is a new benchmark that systematically evaluates 3D consistency in interactive video world models. It organizes evaluation into three dimensions—input preservation, generated‑content persistence, and 3D self‑consistency—using controlled exploration and revisit protocols. The benchmark covers 720 instances across indoor and outdoor scenes and tests 27 different models, providing a comprehensive framework for diagnosing and improving 3D consistency.

arXiv Computer Vision
Oct 7

Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update

arXiv:2610.07031v1 Announce Type: new Abstract: Recent video world models have witnessed the paradigm shift from single-agent to multi-agent involvements, which can reveal more complicated dynamics a...

By Sitian Shen, Jiuming Liu, Mengmeng Liu, Yian Wang, Michael Ying Yang, Francesco Nex, Hao Cheng, Daniele De Martini, Ayush Tewari, Per Ola Kristensson
arXiv Computer Vision
Aug 31

Cyc3D: Evaluating Cyclic Structural Stability and Asset Usability in Image-to-3D Generation

Cyc3D is a new benchmark for image‑to‑3D generation that evaluates both Cross‑View Object Consistency and Representation Quality. It introduces a closed‑loop View‑Cycle Structural Consistency protocol to measure geometric, perceptual, and semantic drift across repeated render‑regenerate cycles, and also assesses asset usability through geometric structure, fidelity, mesh discretization, and UV quality. Experiments show that closed‑source models outperform open‑source baselines yet still score below 48 on cycle stability, highlighting a gap between visual plausibility and robust 3D understanding.

By Liwen Zhang
arXiv Computer Vision
Oct 2

4Director: Controlling Video World Models with Rigid 3D Geometry

arXiv:2610.02160v1 Announce Type: new Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through i...

By Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R, Shimon Vainer, Mark Boss, Yaoyao Liu
arXiv Computer Vision
Aug 28

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.

By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
arXiv AI
Jul 22

AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report

arXiv:2607. 18367v1 Announce Type: new Abstract: Unlike conventional video game development, which relies on labor-intensive pipelines for asset production, animation, physics, and programming, video world models generate interactive environments from user inputs instantly.

By AlayaWorld Team, Kaipeng Zhang, Chuanhao Li, Yifan Zhan, Yongtao Ge, Yuanyang Yin, Jiaming Tan, Kang He, Liaoyuan Fan, Mingliang Zhai, Ruicong Liu, Xiaojie Xu, Xuangeng Chu, Zhen Li, Zhengyuan Lin, Zhixiang Wang, Zian Meng, Zihui Gao
arXiv Computer Vision
4d ago

WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models

arXiv:2610.19063v1 Announce Type: new Abstract: As video models enable longer and more realistic interactive experiences, maintaining a world consistent with its history becomes essential. This requi...

By Nan Zhou, Jianxiong Gao, Qiuyu Wang, Wen Wang, Jiahao Wang, Yufeng Yuan, Shuaiting Li, Hao Ouyang, Yujun Shen, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen
arXiv Computer Vision
Oct 9

WorldAlign: Decoupled 4D Reward for World-Consistent Video Generation

WorldAlign introduces a decoupled 4D reward framework for improving world consistency in generated videos. It separates static regions from dynamic subjects, aligning each with a suitable world prior—geometric priors for static geometry and a vision‑language model for dynamic subjects—using masked reprojection and a VLM‑as‑a‑judge reward. The method enhances both static and dynamic consistency in pretrained image‑to‑video generators without relying on human preference data.

By Jing He, Kaixin Ding, Xingye Tian, Guibao Shen, Wenhang Ge, Xin Tao, Pengfei Wan, Ying-Cong Chen