arXiv AI By Yanchen Huo, Ziying Song, Yadan Luo

Flow-JEPA: Flow Matching for Robust Latent Dynamics in JEPA World Models

Read the original on arXiv AI →

Flow-JEPA introduces a conditional flow matching dynamics model that generates a sequence of future latent states conditioned on current observations and actions, replacing deterministic autoregressive prediction with stochastic trajectory-level prediction. By using a Gaussian flow source, the model learns to transport perturbed latent trajectories toward clean future representations while remaining within the reconstruction‑free JEPA framework. The approach improves mean success rates from 86% to 92% under clean observations and from 67% to 86% under noisy conditions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 24

WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving

arXiv:2608.20974v1 Announce Type: cross Abstract: Video Joint Embedding Predictive Architecture (V-JEPA) learns powerful spatiotemporal representations from video through self-supervised latent featu...

By Xinlin Wang, Yujiao Xiang, Yuheng Zhou, Jingqi Wang, Minqing Huang, Jiajie Huang, Dongxu Wei, Tingguang Zhou, Xiyang Wang, Gong Chen, Zhi Xu, Feiyang Tan, Hangning Zhou, Mu Yang
arXiv Computer Vision
Nov 9

Diffusion-Steering-Based MPC with a JEPA World Action Model

The paper introduces LeWAM, a bidirectional transformer that predicts forward, backward, inverse dynamics, and policy using a decoder‑free JEPA latent trained end‑to‑end. LeWAM’s latent representation aligns better with robot and object states than traditional reconstruction‑based world action models and ignores visual distractors more effectively. In closed‑loop experiments, LeWAM matches the performance of a flow‑matching policy while also providing a world model, and planning in the policy head’s noise space improves MPC performance compared to sampling raw actions.

By Shashank Hegde, Alexander Popov, Elie Aljalbout, Nikolai Smolyanskiy
arXiv AI
Jul 1

Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding

arXiv:2606. 31232v1 Announce Type: new Abstract: Learning visual world models for planning requires compact latent dynamics that remain sensitive to actions, yet reconstruction-free joint-embedding objectives can collapse to action-insensitive representations.

By Zhenghao Zhang, Yuanxiang Wang, Zhenyu Guan, Yujia Yang, Bingkang Shi, Tianyu Zong, Hongzhu Yi, Guoqing Chao, Xingchen Chen, Tiankun Yang, Chenxi Bao, Tao Yu, Jingjing Zhou, Jungang Xu