arXiv AI
H3-World: Turning Language Understanding into World Control
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
1d ago
Hy-Nomas: Towards Free-form Interactive World Generation
arXiv:2610.36729v1 Announce Type: new Abstract: Interactive world generation requires models to follow successive commands while preserving relevant history and action consequences. We present Hy-Nom...
arXiv AI
Oct 9
World-Ego Modeling for Embodied Video Generation in Long-Horizon Navigation-Manipulation Tasks
The paper introduces the World-Ego Model (WEM), which separates an embodied video into a background‐only world component and an ego component comprising the robot and manipulated objects. By using role‑conditioned attention and asymmetric query budgets for state prediction, coupled with a semantic‑routed mixture‑of‑experts diffusion generator, WEM disentangles the generation of scene evolution and instruction following. The authors also release HTEWorld, a large dataset of 125K training clips and 300 evaluation trajectories for long‑horizon navigation‑manipulation tasks, and demonstrate that WEM outperforms prior methods on this benchmark.
Hugging Face Trending Papers
Jul 8
Infinite Worlds with Versatile Interactions
We present LingBot-World 2. 0 (also known as LingBot-World-Infinity), an advanced iteration of LingBot-World featuring four distinct upgrades.
arXiv Machine Learning
Jun 9
Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models
arXiv:2605. 31158v2 Announce Type: replace-cross Abstract: Interactive video world models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time game simulation, virtual scene navigation, and embodied AI training.
arXiv Computer Vision
1d ago
BoxWorld: Let World Engines Control and Video Generators Render
BoxWorld introduces a novel approach to real‑time interactive video worlds by decoupling interaction reasoning from generative rendering. A coding agent builds a Box World Engine that applies user‑defined rules to determine interaction outcomes and exposes object states via a lightweight interface of layout boxes, persistent attributes, and dynamic status variables. A separate Box‑State Generative Renderer then autoregressively renders these evolving states into video, enabling online control over object motion, state switches, and conditional events. The system employs a three‑stage training strategy—learning object grounding from open‑domain videos, state transitions from gameplay videos, and rollout distillation on self‑generated histories—to handle real‑time state updates while maintaining visual coherence. BoxWorld outperforms end‑to‑end world models and remains competitive across multiple public benchmarks, with a new PairedStateBench benchmark for fine‑grained interaction control.
arXiv Machine Learning
Sep 17
Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control
Zing-0.5 is a 5B autoregressive world model that enables users to explore and influence generated worlds through joint keyboard and online text control. It integrates unified action and text conditioning, event-scale supervision for incremental generation, and low-cost real-time interaction, achieving high scores on WBench Navigation. The authors release model weights, inference code, and a serving implementation to support further research on playable generated worlds.