arXiv AI
Jun 9
PRISM: PRior-guided Imagination Sampling in world Models
arXiv:2606. 07974v1 Announce Type: cross Abstract: A learned world model provides a powerful physical intuition for evaluating future states.
Learning Task-Sufficient World Models by Synergizing Agentic Exploration and Structured Modeling
arXiv:2607. 04409v1 Announce Type: new Abstract: Learning and planning in imagination using world models provides an effective paradigm for training agents for decision-making.
Related stories
arXiv AI
Jul 14
Towards Predictive, Aligned, and Scalable Robot Learning
arXiv:2607. 11270v1 Announce Type: cross Abstract: Learning, at its core, extends beyond memorization to the ability to reason and solve novel problems by navigating a space of possibilities.
arXiv AI
Jul 1
Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding
arXiv:2606. 31232v1 Announce Type: new Abstract: Learning visual world models for planning requires compact latent dynamics that remain sensitive to actions, yet reconstruction-free joint-embedding objectives can collapse to action-insensitive representations.
arXiv AI
Jun 16
LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure
arXiv:2606. 15306v1 Announce Type: cross Abstract: We envision continually learning agentic systems that become more useful over time: as they encounter sequences of related tasks, they should infer the hidden structure shared across those tasks and use it to improve future decisions.
arXiv Computer Vision
6d ago
WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving
WALT introduces a method to align latent trajectories with pretrained driving world models, creating a compact generative trajectory space that preserves action-relevant semantics without altering the original model. The approach uses a dual-branch autoencoder to map raw waypoints into this latent space and transfers visual world knowledge into trajectory representations. Experiments on NAVSIM benchmarks show modest performance gains and a 30.5% reduction in planner FLOPs, indicating that maintaining world representations while extracting action-relevant information can improve trajectory planning efficiency.
arXiv Machine Learning
Jun 18
Hierarchical Planning with Latent World Models
arXiv:2604. 03208v2 Announce Type: replace Abstract: World models are a promising path to zero-shot embodied control through planning.
arXiv AI
Jun 17
ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model
arXiv:2603. 22281v2 Announce Type: replace-cross Abstract: Recent progress in latent world models (e.
arXiv AI
Sep 10
PAN: A World Model for General, Actionable, and Long-Horizon World Simulation
arXiv:2511.09057v4 Announce Type: replace-cross Abstract: A world model is a cognitive simulator of the real-world environment allowing biological agents to reason about how the world evolves, whethe...
Hugging Face Trending Papers
Aug 27
Decoupling Planning and Control for Instructable Agents
The paper introduces Instruct-to-Act, a system that decouples high‑level planning from low‑latency control by combining a vision‑language model (VLM) planner with a world‑model controller. The VLM generates sparse, high‑level text instructions, while the controller executes them autonomously at high frequency. Experiments across seven embodied environments, including multi‑agent settings, show that this approach outperforms both controller‑only and direct VLM action‑generation methods, maintains fast control, and allows swapping in different pretrained VLM planners without fine‑tuning.
arXiv Computation and Language
3d ago
EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making
arXiv:2609.38334v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed as agents for multi-step decision-making, yet transfer poorly to unseen environments. World-mode...
arXiv AI
4d ago
Beyond a single latent space: a dual-latent world model for long-horizon planning
The paper introduces the Dual-Latent World Model (Dual-WM), which separates local execution and long-range planning into distinct latent spaces and dynamics models. A new learning method, Long-Horizon Representation Learning with Weighted Rollout (LoRe), supervises predictions at both levels using exponential horizon weights. Experiments on five goal-conditioned visual control tasks show that Dual-WM improves success rates over strong baselines, especially at longer horizons.
arXiv AI
Aug 28
Decoupling Planning and Control for Instructable Agents
The paper introduces Instruct-to-Act, a system that decouples planning and control by combining a vision‑language model (VLM) planner with a world‑model controller. The VLM generates sparse, high‑level text instructions, while the controller executes them at high frequency, trained via relabeling rollouts with synthetic instructions and joint optimization of behavior cloning, reward, and world‑model objectives. Across seven embodied environments—including multi‑agent settings—this approach outperforms controller‑only and direct VLM action methods, maintains fast control, and allows swapping pretrained VLM planners without fine‑tuning, achieving competitive results with strong baselines on most tasks.