Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

28,111 stories · RSS feed

arXiv Computer Vision
Oct 27

WMEval: Evaluating Interactive World Models Grounded on Physical Simulations

arXiv:2610.33894v1 Announce Type: new Abstract: Interactive world models hold immense potential for high-stakes applications in robotics, game engines, and immersive digital twins, yet existing bench...

By Lanxiang Hu, Yixin Huang, Abhilash Shankarampeta, Zilin Dai, Yuyuan Wu, Kun Qian, Junze Liu, Arvind Srinivasan, Mingjia Huo, Will Lin, Kai Zhong, Weiqi Zhang, Tian Wang, Qingjun Cui, Tajana Rosing, Hao Zhang
arXiv Computer Vision
Oct 27

DriveUniTok: A Unified Multimodal Tokenizer for Driving World-Action Models

arXiv:2610.35044v1 Announce Type: new Abstract: World models are emerging as a fundamental component of policy learning for real-world agents, enabling agents to predict future world states and plan...

By Jingbo Xu, Hanchao Leng, JiaHui Huang, Hanbing Li, Jingwei Zhao, Kuiyuan Yang, Chen Gao, Guang Chen, Hangjun Ye, Yong Li
arXiv Computer Vision
Oct 27

InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM Assistants

arXiv:2610.33966v1 Announce Type: cross Abstract: People have long dreamed of an assistant that is always there to guide them and remind what they forget, from new dishes to lost keys. Powered by mul...

By Qinsi Wang, Wei Wen, Chong Zhou, Saksham Suri, Zechun Liu, Lemeng Wu, Hai Helen Li, Yiran Chen, Raghuraman Krishnamoorthi, Qi Qian
arXiv Computer Vision
Oct 27

Model-Aware Generation of Safety-Critical Scenes for Robust End-to-End Driving via Distilled Planner Surrogates

arXiv:2610.35448v1 Announce Type: cross Abstract: End-to-end driving models perform well on standard benchmarks but collide frequently in safety-critical scenarios. We present a failure-mode analysis...

By Khaled M. Seyam (University of Stuttgart, Germany), Julian Wiederer (Mercedes-Benz AG, Germany), Samar Fathalah (University of Stuttgart, Germany), Markus Braun (Mercedes-Benz AG, Germany), Bin Yang (University of Stuttgart, Germany)