arXiv AI By Xiangcheng Zhan, Zirui Chen, Yicheng Zhao, Ziteng Gao, Shuo Yang

Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Computer Vision
Oct 27

GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation

arXiv:2609.05588v3 Announce Type: replace-cross Abstract: World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled inte...

By Renhang Liu, Wenzhi Zhao, Zhuo Yang, Liliang Chen, Pengfei Zhou, Shengcong Chen, Guanghui Ren, Youlun Peng, Rongjun Jin, Nan Wang, Sukai Wang, Xindong He, Jinyuan Feng, Ziyu Xiong, Linqing Zhong, Yifei Wei, Feng Han, Long Zhang, Da Huang, Nanshu Zhao, Chenghao Yin, Mo Wu, Zhaodong Yan, Kongtao Hu, Yuxiang Yan, Aogelijiang Niyazi, Yu Fang, Jia Zeng, Lizhu Meng, Daizhen Lv, Haoyu Cao, Zhiwen Hou, Lianjin Ye, Yuehan Niu, Zhikai Cai, Xuan Hu, Hui Min, Xiongfeng Cai, Yue Liao, Jing Wu, Soujanya Poria, Ye Li, Sanping Zhou, Maoqing Yao, AgiBot Research Team
arXiv Computer Vision
Oct 19

WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions

WorldOracle is a benchmark that evaluates action‑conditioned world models (ACWMs) by comparing their predicted rollouts to paired real‑world executions. It assesses models across four dimensions—physical state correctness, spatial alignment, key interaction fidelity, and multi‑view coherence—using curated training and evaluation suites that include long, multi‑segment episodes with both successful and failed actions. Experiments on seven ACWMs highlight distinct strengths and failure modes, providing a systematic foundation for advancing manipulation modeling.

By Haoyi Duan, Liliang Chen, Nan Wang, Yang Zhang, Yuhang Lu, Xiaotong Chen, Wei-Cheng Tseng, Shenyuan Gao, Zhaoshuo Li, Jingyi Jin, Pooya Jannaty, Dhruv Shah, Yuke Zhu, Ming-Yu Liu, Maoqing Yao, Guanghui Ren