arXiv AI By Zhangbo Xu, Ruoxi Zhang, Rui Hu, Yisong Wang

MultiWorldBench: Do Independently Controlled Views Describe One Shared World?

Read the original on arXiv AI →

MultiWorldBench is a diagnostic Minecraft benchmark designed to test whether independently controlled views can describe a single shared world. It contains 495 case configurations across seven task suites and ten capabilities, such as independent control, cross-view motion, shared-state synchronization, persistence, structural reasoning, concurrent interaction, and delayed revisit. The benchmark evaluates systems like Solaris, Gamma-World, and MineWorld, revealing that none achieve high scores in state persistence, structural consistency, spatial reasoning, or building-identity preservation, and that Gamma-World and Solaris perform best in different subsets of capabilities.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 22

HappyWorld-Bench

arXiv:2609.24308v1 Announce Type: new Abstract: Evaluating world models requires assessing both the quality of the worlds they generate and their consistency and responsiveness under exploration, int...

By Zhiqi Bai, Junai Cai, Yixin Chen, Jingrun Du, Tao Feng, Wei Gong, Siyuan Huang, Xiao Lin, Jiaheng Liu, Jun Luo, Yongzhe Lyu, Liya Ma, Zenan Meng, Lin Qu, Wenbo Su, Jiaming Wang, Qinghe Wang, Shaofei Wang, Yanghai Wang, Zequn Wang, Ziming Wang, Hu Wei, Jiangtao Wu, Ruiqi Wu, Jiaxin Xie, Yuchi Xu, Ze Xu, Chengting Yu, Liangyu Yuan, Gang Zeng, Yawen Zeng, Xingyao Zhang, Zizheng Zhang, Bo Zheng, Jiancheng Zhu, Song-Chun Zhu
Hugging Face Trending Papers
Sep 21

HappyWorld-Bench

Evaluating world models requires assessing both the quality of the worlds they generate and their consistency and responsiveness under exploration, interaction, and modification. We introduce HappyWor...

arXiv AI
Oct 5

World Editing: Intervening on Executable Worlds at Increasing Depth

The paper introduces the concept of world editing—intervening on an existing executable world while preserving unchanged properties—and defines intervention depth as a measure of how strongly edits affect world entities, dynamics, and systems. It presents IGMWorld and IGMBench, a benchmark of 110 tasks across Minecraft and Terraria, evaluating edits through deterministic executability, behavioral, preservation, and visual checks. Frontier coding agents achieve up to 78.2% task-level success and 94.8% criterion-level success, though reliability drops with deeper interventions and visual consistency remains low.

By Max Ku, Nok-Kan Law, Yu-Chien Tang, Shih-Ying Yeh, Ping Nie, Andy Zheng, Tat Hei Lai, Fei-Yueh Chen, Nikko Yu, Wei-Chieh Sun, Suzy Huang, Chiao-Wei Hsu, Chih-Chuan Huang, Chak-Wing Mak, Ho Yin Sam Ng, Edisy Kin Wai Chan, Min-Hung Chen, Ho Kei Cheng
arXiv Computation and Language
Aug 28

MineExplorer: Evaluating Open-World Exploration of MLLM Agents in Minecraft

MineExplorer is a benchmark designed to assess the open‑world exploration abilities of multimodal large language models (MLLMs) in Minecraft. It filters out tasks that rely heavily on Minecraft‑specific knowledge, organizes tasks into ReAct‑style capabilities, and composes atomic tasks into implicit multi‑hop challenges. A multi‑agent synthesis workflow creates reliable task graphs, sandbox scenes, and rule‑based milestone evaluators, and human evaluation confirms its superiority over a single‑agent baseline. Experiments show that while advanced MLLMs can handle many single‑hop tasks, they struggle with longer trajectories that require coordinating hidden prerequisites, and larger models or different thinking modes do not consistently improve performance.

By Tianjie Ju, Yueqing Sun, Zheng Wu, Wei Zhang, Yaqi Huo, Xi Su, Qi Gu, Xunliang Cai, Gongshen Liu, Zhuosheng Zhang