arXiv Machine Learning By Konstantinos Mylonas, Thrasyvoulos Spyropoulos

Learning Latent Goal Costs for Visual World-Model Planning with an Expanding Curriculum

Read the original on arXiv Machine Learning →

The paper introduces a method to refine latent goal costs for image‑goal planning by adding a small residual adapter to frozen I‑JEPA embeddings. The adapter learns from successful and failed rollouts without task‑specific labels, improving planner performance on DotWall and PointMaze benchmarks. Experiments show success rates rising from 54% to 98% in DotWall and from 82% to 96% in PointMaze, and better alignment with shortest‑path ordering on unseen layouts.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 9

How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models

The paper introduces TEMPO, a temporal-distance planning objective that augments latent world models by learning a map of the frozen latent space where distances correspond to the number of environment steps between states. TEMPO blends this learned temporal distance into the planner’s cost, requiring no additional rewards or policies, and adds negligible computational overhead. Experiments on eleven simulated environments show that TEMPO consistently improves planner performance across all goal distances, notably raising LeWM’s success rate from 36% to 99% on the TwoRoom task.

By Lama Moukheiber, Haotian Xue, Yongxin Chen
arXiv AI
Sep 30

Beyond a single latent space: a dual-latent world model for long-horizon planning

The paper introduces the Dual-Latent World Model (Dual-WM), which separates local execution and long-range planning into distinct latent spaces and dynamics models. A new learning method, Long-Horizon Representation Learning with Weighted Rollout (LoRe), supervises predictions at both levels using exponential horizon weights. Experiments on five goal-conditioned visual control tasks show that Dual-WM improves success rates over strong baselines, especially at longer horizons.

By Delin Zhao, Zhengrong Yue, Shaobin Zhuang, Junlin He, Xiaoyu Chen, Zikang Wang, Yuxin Liu, Limin Wang, Yali Wang
arXiv Machine Learning
Sep 22

FIRM-WM: State-factorized factual-interventional recurrent modeling for reward-free visual planning

FIRM-WM is a compact pixel world model that separates a goal‑comparable configuration from a 128‑dimensional dynamic fiber, enabling reward‑free visual planning from offline videos. It addresses two key mismatches: aligning planning states with goal images and reconciling factual trajectories with interventional sampling. In experiments, FIRM‑WM achieves high success rates on TwoRoom, Reacher, and OGBench‑Cube while using fewer parameters and faster planning times than prior models.

By Yilun Wu, Yunjian Zhang, Aobo Li, Mujiangshan Wang, Haitao Wu, Aqiang Zhang