arXiv AI

PanoWorld: Geometry-Consistent Panoramic Video World Modeling

arXiv AI
Oct 27

OmniShowcase: Omnidirectional Subject-Consistent Video Generation from Multi-View Images

OmniShowcase introduces a method for generating omnidirectional videos of a specific subject from a handful of multi‑view images. It combines an automated data‑synthesis pipeline that creates training videos with diverse camera trajectories driven by the subject’s geometry, and a geometry‑conditioning technique that supplies the model with surface‑normal maps reconstructed from the reference views. The authors release Showcase‑4K, a large corpus of 3D‑asset‑based videos with 12 camera motions and 88 trajectory configurations, and ShowcaseBench, a held‑out evaluation set with source meshes and camera parameters.

By Junyeong Ahn, Geonwoo Kim, Kinam Kim, Gihwi Kim, Hoonjin Jung, Hyojin Jang, Jaegul Choo
arXiv Computer Vision
Sep 30

MUGEN: Interactive Panoramic World Exploration via Camera Control

MUGEN is a large‑scale real‑world dataset of over 1,300 hours of 4K panoramic videos with rich semantic and geometric annotations, designed to support interactive 360° world exploration. Wan360 is a camera‑controllable panoramic video generation model built on MUGEN, featuring ERP‑aware components (periodic longitude RoPE, ERP‑aware padding, random roll yaw) and a panoramic Plücker embedding for camera motion. Together, they address gaps in data and model support for immersive, temporally coherent 360° video generation along user‑specified camera trajectories.

By Jiaming Tan, Zhen Li, Shuwei Shi, Minggui Teng, Siqi Yang, Yuwei Wu, Bo Zheng, Chuanhao Li, Kaipeng Zhang
arXiv Computer Vision
Oct 7

Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update

arXiv:2610.07031v1 Announce Type: new Abstract: Recent video world models have witnessed the paradigm shift from single-agent to multi-agent involvements, which can reveal more complicated dynamics a...

By Sitian Shen, Jiuming Liu, Mengmeng Liu, Yian Wang, Michael Ying Yang, Francesco Nex, Hao Cheng, Daniele De Martini, Ayush Tewari, Per Ola Kristensson
Hugging Face Trending Papers
Jun 11

MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold

We present MoVerse, a real-time video world model that creates an interactively navigable scene from a single narrow-field-of-view image. This setting is challenging because the input observes only a small fraction of the environment, while interactive roaming requires a complete surrounding world, persistent geometry, controllable camera motion, and temporally coherent high-fidelity observations.

arXiv Computer Vision
4d ago

Think in 360{\deg}: Benchmarking and Bootstrapping Panoramic Video Reasoning

The paper introduces PanoVideoBench, a manually annotated benchmark with 1,000 questions covering five categories and 15 question types for panoramic video understanding, and identifies cross‑view tracking and sphere‑time evidence integration as weak points in existing models. To address these gaps, the authors create PanoVideoCoT, a dataset of 13,465 QA‑CoT pairs generated via sphere‑time‑grounded synthesis, and train PanoVideoReasoner using panoramic CoT fine‑tuning and evidence‑privileged on‑policy self‑distillation. The resulting model achieves 55.7% accuracy on PanoVideoBench, improving the baseline by 12.5 points and surpassing the previous state‑of‑the‑art by 2.6 points, particularly in spatial, cross‑view, and temporal reasoning.

By Lidong Lu, Lidong Zou, Xinyi Mao, Jiaxin Lv, Zhenquan Li, Liangrui Dong, Tong Lu, Guo Chen
arXiv Computer Vision
Oct 2

World Observer: Joint Actor-Observer Generation for Persistent World Modeling

World Observer introduces a joint actor‑observer framework for persistent world modeling, decoupling the agent’s view from panoramic observers that track regions outside the actor’s field of view. By warping from a shared panoramic source and using an Observer Sink for high‑resolution references, the method maintains accurate object states and dynamics even when they leave and re‑enter the actor’s view. The approach is evaluated with new world‑space metrics and a benchmark across real and synthetic scenes, showing improved out‑of‑view dynamics while preserving visual fidelity, camera control, and 3D adherence.

By Hyunwook Choi, Dahyun Chung, Hyunsung Kim, Siyoon Jin, Jinhyeok Choi, Junyoung Seo, Seungryong Kim