arXiv Computer Vision
Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Sep 1
Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
arXiv:2608.29910v1 Announce Type: new Abstract: Interactive world models extend video generation from offline clip synthesis toward persistent simulation of interactive virtual worlds, enabling appli...
arXiv Computer Vision
2d ago
Matrix-game 2.0: An open-source, real-time, and streaming interactive world model
arXiv:2508.13009v5 Announce Type: replace Abstract: Recent advances in interactive video generations have demonstrated diffusion model's potential as world models by capturing complex physical dynami...
arXiv AI
Jul 22
AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
arXiv:2607. 18367v1 Announce Type: new Abstract: Unlike conventional video game development, which relies on labor-intensive pipelines for asset production, animation, physics, and programming, video world models generate interactive environments from user inputs instantly.
arXiv AI
Jun 10
BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression
arXiv:2606. 10135v1 Announce Type: cross Abstract: Transitioning bidirectional video diffusion models into an autoregressive paradigm improves the interactivity of video world models, but existing causal pipelines need many stages (control fine-tuning, autoregressive training, causal initialization, few-step distillation) and still trail bidirectional models in quality due to error accumulation.
arXiv Computer Vision
Aug 25
VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding
arXiv:2607.14935v2 Announce Type: replace Abstract: Recent advances in video understanding have spanned motion, long video, and streaming interaction, driving this field toward real-world application...
arXiv Computer Vision
Sep 3
SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
SolarWM is an open foundation for building interactive video world models, offering a reconfigurable multi‑source data engine that unifies 1.43 million clips from 10 datasets into a consistent, frame‑aligned format. It provides a backbone‑native adaptation framework that preserves native representations of models ranging from 5 B to 33 B parameters, and a three‑stage training recipe combining bidirectional adaptation, teacher‑forced autoregressive initialization, and distribution‑matching distillation. The resulting causal models can interact in real‑time over rollouts from minutes to hours, trained only on 5‑second sequences, and the project releases data, pipeline, recipes, weights, and framework for reproducible research.