arXiv:2611.08128v1 Announce Type: new
Abstract: Current 4D occupancy world models use heavy cross-attention or deep recurrence to disentangle ego-motion from scene dynamics. This requires significant...
By Zeping Zhang, Zhuoya Zhao, Samy Metari, Robert Lagani\`ere
arXiv:2607. 04541v1 Announce Type: cross Abstract: Camera-radar (CR) fusion is a practical sensing configuration for autonomous driving, but existing models are typically trained with task-specific supervision, limiting reusable representation learning.
By Jingyu Song, Yi Liu, Katherine A. Skinner
arXiv:2606. 09811v1 Announce Type: cross Abstract: World-action models have emerged as a promising paradigm for robot manipulation, jointly modeling visual scene dynamics and actions to inject physical priors into policy learning.
By Jisong Cai, Long Ling, Shiwei Chu, Zhongshan Liu, Jiayue Kang, Zhixuan Liang, Wenjie Xu, Yinan Mao, Weinan Zhang, Xiaokang Yang, Ru Ying, Ran Zheng, Yao Mu
WorldFlow is a generative world model that jointly predicts future video frames and query-based 3D trajectories using a unified Mixture-of-Transformers backbone. It represents 3D motion as continuous displacement tokens aligned with the video grid and optimizes a rectified-flow objective to couple explicit geometric dynamics with visual evolution. Trained on 1.44 million heterogeneous samples and evaluated on WorldFlowBench, it achieves the lowest average and final displacement errors among learning-based methods, notably outperforming baselines on spatial reasoning tasks.
By Yuhao Lu, Jiongxu Chen, Hexiang Wei, Jiajin Wu, Juelin Li, Mingjian Liang, Fan Yang, Zhuowei Liang, Zihao Liu, Zhennan Wang, Sheng Wang, Lin Shao
arXiv:2608. 07420v1 Announce Type: new Abstract: World models are expected to support imagination over extended temporal horizons, yet most are still trained through local few-step prediction objectives and deployed by recursively rolling out their own predictions.
By Xinyi Li, Zaishuo Xia, Chenjie Hao, Yubei Chen
arXiv:2606. 26217v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models.
By Yuntian Gao, Xiangyu Xu