arXiv:2608. 08600v1 Announce Type: cross Abstract: World models have recently achieved impressive progress in visual prediction and interactive generation, but extending them to multi-agent environments introduces a fundamental scalability challenge.
arXiv:2603. 02697v2 Announce Type: replace-cross Abstract: This paper presents ShareVerse, a video generation framework enabling multi-agent shared world modeling, addressing the gap in existing works that lack support for unified shared world construction with multi-agent interaction.
arXiv:2610.07031v1 Announce Type: new Abstract: Recent video world models have witnessed the paradigm shift from single-agent to multi-agent involvements, which can reveal more complicated dynamics a...
AgentGarten is a framework that links simulators and game engines with a shared neural renderer to create real‑time interactive virtual worlds. It uses a pretrained video model adapted to geometry conditions, refined with Adversarial Forcing, to produce realistic visual observations while maintaining consistent state and rules. The system enables agents to learn efficiently—achieving comparable performance in only four training rounds versus millions in traditional reinforcement learning—by distilling experience into playbooks that successive agents can inherit and improve upon.
arXiv:2603. 03482v2 Announce Type: replace-cross Abstract: Interactive world models continually generate video by responding to a user's actions, enabling open-ended generation capabilities.
arXiv:2609.10540v1 Announce Type: new Abstract: Recent video world models generate increasingly realistic and interactive visual experiences, yet lack reliable mechanisms for maintaining persistent w...
The paper introduces CoDeR, a new paradigm for world modeling that explicitly builds an executable world using code rather than relying solely on visual observations. CoDeR translates high‑level concepts into structured world rules, executable dynamics, and perceptual observations through five complementary roles, enabling long‑term memory, open‑ended interactions, autonomous world evolution, and persistent multi‑agent dynamics. Experiments show that this framework extends the capabilities of existing world models and achieves state‑of‑the‑art performance across multiple evaluation settings.
WorldProbe is a new diagnostic benchmark that tests video world models by letting a goal‑conditioned multimodal agent adapt camera actions online during generation, creating 164 test cases across four probing families. The benchmark evaluates 10 state‑of‑the‑art models over more than 1,600 rollouts, totaling roughly 800 minutes and horizons up to 180 seconds, revealing that while local visual and content quality can be maintained for longer, long‑range memory and evolution remain weak. The study highlights a gap between locally stable generation and persistent world consistency that existing short‑interaction benchmarks miss.
arXiv:2606. 02753v1 Announce Type: cross Abstract: Video world models are a foundational generative technology for embodied AI and the Metaverse, yet existing approaches are inherently limited to a single agent observing from a single perspective.
arXiv:2610.28554v1 Announce Type: new Abstract: Despite the success of video world models, extending them to multiple agents is difficult because it requires generating several agent-specific video s...
World Observer introduces a joint actor‑observer framework for persistent world modeling, decoupling the agent’s view from panoramic observers that track regions outside the actor’s field of view. By warping from a shared panoramic source and using an Observer Sink for high‑resolution references, the method maintains accurate object states and dynamics even when they leave and re‑enter the actor’s view. The approach is evaluated with new world‑space metrics and a benchmark across real and synthetic scenes, showing improved out‑of‑view dynamics while preserving visual fidelity, camera control, and 3D adherence.
BoxWorld introduces a novel approach to real‑time interactive video worlds by decoupling interaction reasoning from generative rendering. A coding agent builds a Box World Engine that applies user‑defined rules to determine interaction outcomes and exposes object states via a lightweight interface of layout boxes, persistent attributes, and dynamic status variables. A separate Box‑State Generative Renderer then autoregressively renders these evolving states into video, enabling online control over object motion, state switches, and conditional events. The system employs a three‑stage training strategy—learning object grounding from open‑domain videos, state transitions from gameplay videos, and rollout distillation on self‑generated histories—to handle real‑time state updates while maintaining visual coherence. BoxWorld outperforms end‑to‑end world models and remains competitive across multiple public benchmarks, with a new PairedStateBench benchmark for fine‑grained interaction control.