arXiv Machine Learning
Aug 10
Addressable Memory for Video World Models
arXiv:2608. 07408v1 Announce Type: cross Abstract: We study visual persistence in interactive video world models.
WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
arXiv:2512. 02473v2 Announce Type: replace-cross Abstract: Video world models have attracted significant attention for their ability to produce high-fidelity future visual observations conditioned on past observations and navigation actions.
Related stories
arXiv AI
Jul 22
AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
arXiv:2607. 18367v1 Announce Type: new Abstract: Unlike conventional video game development, which relies on labor-intensive pipelines for asset production, animation, physics, and programming, video world models generate interactive environments from user inputs instantly.
Hugging Face Trending Papers
Jun 11
MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold
We present MoVerse, a real-time video world model that creates an interactively navigable scene from a single narrow-field-of-view image. This setting is challenging because the input observes only a small fraction of the environment, while interactive roaming requires a complete surrounding world, persistent geometry, controllable camera motion, and temporally coherent high-fidelity observations.
arXiv AI
Jul 2
Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences
arXiv:2607. 00832v1 Announce Type: cross Abstract: A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration.
arXiv AI
Jun 2
Real2SAM2Real: Generative 3D Caches as Complementary Context for Video Diffusion
arXiv:2606. 00299v1 Announce Type: cross Abstract: While Video Diffusion Models (VDMs) excel at synthesizing high-fidelity videos, enabling precise camera and scene control remains challenging.
arXiv AI
Jun 4
Beyond Pixel Histories: World Models with Persistent 3D State
arXiv:2603. 03482v2 Announce Type: replace-cross Abstract: Interactive world models continually generate video by responding to a user's actions, enabling open-ended generation capabilities.
arXiv AI
Aug 10
WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN
arXiv:2608. 07267v1 Announce Type: new Abstract: Recent vision-language navigation (VLN) systems increasingly adapt pretrained vision-language models (VLMs) into vision-language-action (VLA) policies that map egocentric observations and language instructions directly to navigation actions.
arXiv AI
5d ago
AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)
arXiv:2608. 13492v1 Announce Type: new Abstract: This report presents an improved version of AlayaWorld.
arXiv AI
Jun 12
GeoWorld-VLM: Geometry from World Models for Vision-Language Models
arXiv:2605. 16713v2 Announce Type: replace-cross Abstract: Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between.
Hugging Face Trending Papers
Aug 4
UniNav: A Unified World-Action Diffusion Model for Visual Navigation
Image-goal visual navigation is a fundamental capability for embodied agents. Existing navigation policies efficiently predict waypoint trajectories but lack visual foresight, while navigation world models can anticipate future observations but often require costly planning rollouts.
arXiv AI
Aug 5
UniNav: A Unified World-Action Diffusion Model for Visual Navigation
arXiv:2608. 03244v1 Announce Type: new Abstract: Image-goal visual navigation is a fundamental capability for embodied agents.
arXiv AI
Jun 3
MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
arXiv:2606. 02753v1 Announce Type: cross Abstract: Video world models are a foundational generative technology for embodied AI and the Metaverse, yet existing approaches are inherently limited to a single agent observing from a single perspective.