arXiv Machine Learning
Jun 18
Hierarchical Planning with Latent World Models
arXiv:2604. 03208v2 Announce Type: replace Abstract: World models are a promising path to zero-shot embodied control through planning.
Enhancing Latent World Models with Associative Memory
Related stories
arXiv AI
4d ago
Exploring Temporal Context-Aware Physical Grounding in Latent World Models
arXiv:2610.28483v1 Announce Type: new Abstract: Learning latent dynamics is fundamental to building action-conditioned world models for planning. Among existing families, Joint Embedding Predictive A...
Hugging Face Trending Papers
4d ago
Exploring Temporal Context-Aware Physical Grounding in Latent World Models
Learning latent dynamics is fundamental to building action-conditioned world models for planning. Among existing families, Joint Embedding Predictive Architectures (JEPAs) offer a natural framework by...
arXiv AI
Jul 21
SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planning
arXiv:2607. 17973v1 Announce Type: new Abstract: Latent world models have emerged as a powerful planning paradigm by learning action-conditioned predictive dynamics and using them as internal simulators to imagine and evaluate candidate action sequences.
arXiv Machine Learning
Sep 7
Spectral-Target Physical Latent Structuring for JEPA-Style World Models
The paper introduces a lightweight Fourier auxiliary head to enforce physically-informed structuring of latent states in JEPA-style world models, addressing a newly identified failure mode called physical representation laziness that hampers planning in dynamic environments. Experiments show that this auxiliary supervision improves planning success rates, enhances latent space correlations with key physical properties, and boosts data efficiency, even when the baseline model does not exhibit laziness.
arXiv AI
Jun 9
FF-JEPA: Long-Horizon Planning in World Models with Latent Planners
arXiv:2606. 09311v1 Announce Type: new Abstract: Joint Embedding Predictive Architectures (JEPAs) have shown promising world modeling capabilities, enabling planning in latent space by optimizing action trajectories using methods like the Cross-Entropy Method (CEM).
arXiv AI
Jul 1
Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding
arXiv:2606. 31232v1 Announce Type: new Abstract: Learning visual world models for planning requires compact latent dynamics that remain sensitive to actions, yet reconstruction-free joint-embedding objectives can collapse to action-insensitive representations.
arXiv AI
Aug 11
Energy-Structured Latent World Models with Neural Time Fields for Physically Constistent Open-World Motion Planning
arXiv:2608. 09876v1 Announce Type: cross Abstract: Physically consistent motion planning remains a fundamental challenge in embodied AI, as generated trajectories must strictly conform to real-world execution dynamics.
arXiv Computer Vision
Aug 26
LeFlow: Generative Latent Flow Planning for World Models
arXiv:2608.24855v1 Announce Type: new Abstract: Latent world models are inherently strong encoders that transform image pixel to latent embedding, yet existing world models still rely on online traje...
arXiv AI
Oct 5
Latent Goal Prediction from Language for Model-Based Planning
arXiv:2606.20627v2 Announce Type: replace Abstract: Joint-Embedding Predictive Architectures (JEPAs) enable agents to plan in latent space by imagining the outcomes of candidate actions, yet task spe...
arXiv AI
Sep 30
Beyond a single latent space: a dual-latent world model for long-horizon planning
The paper introduces the Dual-Latent World Model (Dual-WM), which separates local execution and long-range planning into distinct latent spaces and dynamics models. A new learning method, Long-Horizon Representation Learning with Weighted Rollout (LoRe), supervises predictions at both levels using exponential horizon weights. Experiments on five goal-conditioned visual control tasks show that Dual-WM improves success rates over strong baselines, especially at longer horizons.
arXiv Machine Learning
4d ago
LaLa-World: Scaling Latent World Models with Natural Language Actions
arXiv:2610.27851v1 Announce Type: cross Abstract: This paper shows that JEPA-style latent world models (LWMs) can learn across diverse domains and data sources by adopting the language-conditioned in...