← Back to all news

Related stories

arXiv Computer Vision
Oct 15

Generative World Simulation with DAO and JING

arXiv:2610.19726v1 Announce Type: new Abstract: We present a Generative World Simulation framework that couples persistent shared world state with continuous first-person audiovisual generation. The...

By XGEN Team, Guohao Cai, Haoxuan Che, Frank Fan, Chenran Huang, Junjia Huang, Jiayi Jiang, Yanheng Li, Leon Liu, Shaoteng Liu, Xi Liu, Feng Nie, Zhefan Rao, An Wang, Hanwen Wang, Pengxiang Yan, Jieming Yu, Qian Zha, Wentao Zheng
agents
More like this →
arXiv Computer Vision
Oct 16

RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay

RIGen introduces a framework for reciprocal interaction in generative gameplay, combining persistent state, configurable rules, contextual reasoning, and action-conditioned audiovisual generation. The system ensures that player actions have lasting consequences and that the generated world behaves according to its own state and rules, shaping future player choices. Using a Xonotic gameplay dataset, RIGen trains an audiovisual generator and later deploys it in an interactive FPS prototype, showing more reliable combat outcomes and reciprocal interaction.

By Mengfei Li, Yi Zhang, Xingtong Ge, Lunjie Zhu, Fangyu Lin, Peng Li, Guanglu Song, Yu Liu, Wei Xue, Wenhan Luo, Yike Guo
diffusion
More like this →
arXiv Computer Vision
Oct 2

Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models

Oneira is an interactive video world model that links open-ended generation with persistent interaction. It uses a coding agent to manage an extensible world state, allowing newly generated or discovered entities to become actionable and ensuring that changes made by an agent are retained across video segments. Experiments demonstrate that Oneira supports consistent interaction with new objects while preserving prior interaction effects over long horizons.

By Xindi Yang, Baolu Li, Liam Lee, Zhenfei Yin, Songxin Zhang, Zhuoyang Song, Xu Jia, Jianfei Cai, Tien-Tsin Wong, Bingyi Jing, Mengyue Yang
agents
More like this →
arXiv Computer Vision
Aug 25

EchoWM: Open and Enterable Omnimodal World Models

arXiv:2608.23189v1 Announce Type: new Abstract: We present EchoWM, an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video,...

By Songchun Zhang, Yaowei Li, Junhao Zhuang, Weiyang Jin, Haoyu Wang, Xin Lu, Yilang Sun, Shiyi Zhang, Haoran Li, Xiaoxiao Ma, Yuming Li, Yijun Liu, Yaofeng Su, Yanwen Ma, Haoyu Wu, Zihan Su, Yue Ma, Lvmin Zhang, Haoyang Huang, Zeyue Xue, Anyi Rao, Nan Duan
multimodalbenchmarks
More like this →
arXiv Computer Vision
Aug 25

Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds

arXiv:2608.23383v1 Announce Type: new Abstract: Video generation is progressing beyond isolated clips toward long-form narratives and interactive worlds, requiring models to preserve identities, foll...

By Nan Duan, Haoyang Huang, Weiyang Jin, Haoran Li, Yaowei Li, Yuming Li, Yijun Liu, Xin Lu, Xiaoxiao Ma, Yanwen Ma, Yaofeng Su, Yilang Sun, Haoyu Wang, Zeyue Xue, Songchun Zhang, Junhao Zhuang
diffusionmultimodalsafety
More like this →