arXiv:2608.29029v3 Announce Type: replace-cross
Abstract: Joint-Embedding Predictive Architectures (JEPAs) provide a powerful framework for latent world modeling and planning in a reconstruction-free...
By Yanchen Huo, Ziying Song, Yadan Luo
arXiv:2608.24855v1 Announce Type: new
Abstract: Latent world models are inherently strong encoders that transform image pixel to latent embedding, yet existing world models still rely on online traje...
By Hsiang-Wei Huang, Jianxu Shangguan, Junbin Lu, Jenq-Neng Hwang
arXiv:2608.20974v1 Announce Type: cross
Abstract: Video Joint Embedding Predictive Architecture (V-JEPA) learns powerful spatiotemporal representations from video through self-supervised latent featu...
By Xinlin Wang, Yujiao Xiang, Yuheng Zhou, Jingqi Wang, Minqing Huang, Jiajie Huang, Dongxu Wei, Tingguang Zhou, Xiyang Wang, Gong Chen, Zhi Xu, Feiyang Tan, Hangning Zhou, Mu Yang
The paper introduces LeWAM, a bidirectional transformer that predicts forward, backward, inverse dynamics, and policy using a decoder‑free JEPA latent trained end‑to‑end. LeWAM’s latent representation aligns better with robot and object states than traditional reconstruction‑based world action models and ignores visual distractors more effectively. In closed‑loop experiments, LeWAM matches the performance of a flow‑matching policy while also providing a world model, and planning in the policy head’s noise space improves MPC performance compared to sampling raw actions.
By Shashank Hegde, Alexander Popov, Elie Aljalbout, Nikolai Smolyanskiy
arXiv:2606. 31232v1 Announce Type: new Abstract: Learning visual world models for planning requires compact latent dynamics that remain sensitive to actions, yet reconstruction-free joint-embedding objectives can collapse to action-insensitive representations.
By Zhenghao Zhang, Yuanxiang Wang, Zhenyu Guan, Yujia Yang, Bingkang Shi, Tianyu Zong, Hongzhu Yi, Guoqing Chao, Xingchen Chen, Tiankun Yang, Chenxi Bao, Tao Yu, Jingjing Zhou, Jungang Xu
arXiv:2606. 29059v1 Announce Type: cross Abstract: World modeling requires forecasting uncertain futures while preserving information useful for downstream perception.
By Francois Porcher, Nicolas Carion, Karteek Alahari, Shizhe Chen