arXiv Computer Vision By Zeping Zhang, Zhuoya Zhao, Robert Lagani\`ere

UFMF: Radar-Guided Kinematic Priors for Real-Time 4D Occupancy Forecasting

Read the original on arXiv Computer Vision →

UFMF (Ultra-Fast Multi-modal Forecaster) is a real‑time 4D occupancy forecasting model that uses a lightweight diagonal state‑space core and a radar‑guided velocity‑aware dynamic prior to predict future motion. The prior splits future displacement into a linear extrapolation and a learned residual, enabling per‑cell flow fields that carry a compact dynamic latent subspace during rollout. With auxiliary world‑frame dynamic supervision and class‑conditioned vertical‑profile supervision, UFMF achieves 122 FPS on an RTX 4090 and outperforms recent occupancy world models on nuScenes while using far less computational resources.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jun 9

AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing

arXiv:2606. 09811v1 Announce Type: cross Abstract: World-action models have emerged as a promising paradigm for robot manipulation, jointly modeling visual scene dynamics and actions to inject physical priors into policy learning.

By Jisong Cai, Long Ling, Shiwei Chu, Zhongshan Liu, Jiayue Kang, Zhixuan Liang, Wenjie Xu, Yinan Mao, Weinan Zhang, Xiaokang Yang, Ru Ying, Ran Zheng, Yao Mu
arXiv AI
6d ago

WorldFlow: Joint Video and 3D Motion Prediction via Large-Scale Pretraining

WorldFlow is a generative world model that jointly predicts future video frames and query-based 3D trajectories using a unified Mixture-of-Transformers backbone. It represents 3D motion as continuous displacement tokens aligned with the video grid and optimizes a rectified-flow objective to couple explicit geometric dynamics with visual evolution. Trained on 1.44 million heterogeneous samples and evaluated on WorldFlowBench, it achieves the lowest average and final displacement errors among learning-based methods, notably outperforming baselines on spatial reasoning tasks.

By Yuhao Lu, Jiongxu Chen, Hexiang Wei, Jiajin Wu, Juelin Li, Mingjian Liang, Fan Yang, Zhuowei Liang, Zihao Liu, Zhennan Wang, Sheng Wang, Lin Shao
arXiv Machine Learning
Jun 26

Fast LeWorldModel

arXiv:2606. 26217v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models.

By Yuntian Gao, Xiangyu Xu