arXiv Computer Vision

EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memory

arXiv Computer Vision
Oct 16

Orbia: Do Generated Videos Form a Consistent 3D World?

Orbia is a new benchmark that systematically evaluates 3D consistency in interactive video world models. It organizes evaluation into three dimensions—input preservation, generated‑content persistence, and 3D self‑consistency—using controlled exploration and revisit protocols. The benchmark covers 720 instances across indoor and outdoor scenes and tests 27 different models, providing a comprehensive framework for diagnosing and improving 3D consistency.

By Dongyue Lu, Guian Fang, Hur Lim, Yonggang Wu, Yanrong Wang, Hongshan Chen, Shengju Qian, Yue Liao, Wei Chow, Lingdong Kong, Tianxin Huang, Yu Yang, Hongji Yang, Junchao Huang, Ao Liang, Yihao Wang, Zihan Wang, Rong Li, Hanlin Chen, Xin Wang, Wei Tsang Ooi, Mike Zheng Shou, Shuicheng Yan
arXiv Computer Vision
Oct 15

Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence

arXiv:2610.19502v1 Announce Type: new Abstract: Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominat...

By Yuanyuan Gao, Zhirui Liu, Yuning Gong, Yifei Liu, Yifan Zhan, Kuixuan Jiao, Xiaolong Zhou, Yifan Yang, Hongjie Zhang, Xue Yang, Dan Xu, Zhihang Zhong
Hugging Face Trending Papers
Oct 29

WorldProbe: When Video World Models Fall Apart under Long-Horizon Spatial Exploration

WorldProbe is a new diagnostic benchmark that tests video world models by letting a goal‑conditioned multimodal agent adapt camera actions online during generation, creating 164 test cases across four probing families. The benchmark evaluates 10 state‑of‑the‑art models over more than 1,600 rollouts, totaling roughly 800 minutes and horizons up to 180 seconds, revealing that while local visual and content quality can be maintained for longer, long‑range memory and evolution remain weak. The study highlights a gap between locally stable generation and persistent world consistency that existing short‑interaction benchmarks miss.

arXiv Computer Vision
Sep 22

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

WorldCrafter is a video world model that introduces a camera‑queryable implicit 3D‑aware memory to improve long‑horizon consistency and viewpoint control. The model compresses multi‑view evidence into a limited token budget shaped by the requested viewpoint, integrating historical observations via a memory encoder and pose‑conditioned readout before denoising. Experiments on static and dynamic scenes demonstrate significant gains in consistency and camera‑control accuracy while maintaining visual quality during minute‑scale exploration.

By Wangbo Yu, Kunhao Liu, Wenbo Hu, Shenghai Yuan, Chaoran Feng, Haiyang Zhou, Yukun Huang, Yiran Wang, Wang Zhao, Yingmin Luo, Ying Shan
arXiv Computer Vision
Sep 4

OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping

OctWorld is a video diffusion framework that uses a persistent 3D memory called OctMap to generate long‑range, world‑consistent videos from a single image. OctMap fuses visual observations and depth maps into a dynamic sparse octree, adapting spatial resolution to image evidence while keeping memory usage low. Experiments show that OctWorld produces spatially consistent videos over extended camera paths and outperforms previous methods on both standard benchmarks and challenging long‑range scenarios.

By Zelong Lv, Sicheng Xu, Jianfeng Xiang, Ruicheng Wang, Yue Dong, Yu Deng, Guangzhong Sun, Jiaolong Yang