arXiv AI

LeHami: Symplectic Latent Dynamics for World Models

arXiv Computer Vision
Sep 28

WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving

WALT introduces a method to align latent trajectories with pretrained driving world models, creating a compact generative trajectory space that preserves action-relevant semantics without altering the original model. The approach uses a dual-branch autoencoder to map raw waypoints into this latent space and transfers visual world knowledge into trajectory representations. Experiments on NAVSIM benchmarks show modest performance gains and a 30.5% reduction in planner FLOPs, indicating that maintaining world representations while extracting action-relevant information can improve trajectory planning efficiency.

By Mingkai Jia, Jiaxin Guo, Zhijian Shu, Jiawei Xu, Mingxiao Li, Jintao Cheng, Ping Tan, Wei Yin
arXiv AI
Jul 1

Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding

arXiv:2606. 31232v1 Announce Type: new Abstract: Learning visual world models for planning requires compact latent dynamics that remain sensitive to actions, yet reconstruction-free joint-embedding objectives can collapse to action-insensitive representations.

By Zhenghao Zhang, Yuanxiang Wang, Zhenyu Guan, Yujia Yang, Bingkang Shi, Tianyu Zong, Hongzhu Yi, Guoqing Chao, Xingchen Chen, Tiankun Yang, Chenxi Bao, Tao Yu, Jingjing Zhou, Jungang Xu
arXiv Machine Learning
Oct 3

Variational Streaming Flow: Probabilistic Forecasting in Physical Time

Variational Streaming Flow (VSF) extends the efficient Streaming Flow (SF) framework by learning a latent distribution conditioned on system dynamics, enabling probabilistic forecasting in physical time. Unlike SF’s deterministic velocity field, VSF produces multiple plausible future trajectories, improving predictive accuracy and distributional fidelity across deterministic and stochastic dynamical systems. The method supports long‑horizon rollouts over 1,000 steps, handles bifurcating dynamics, and can be integrated as a plug‑and‑play predictor into Joint‑Embedding Predictive Architecture (JEPA) world models to enhance navigation, motion planning, and manipulation tasks.

By Hans Hao-Hsun Hsu, Minseon Gwak, Soon Hoe Lim, Pan Li, N. Benjamin Erichson