arXiv AI
World Model Science: Self-Organized Criticality, Weak Chaos, and Metastable Belief Dynamics in Long-Horizon LLM Agents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 1
World-Model Collapse as a Phase Transition
arXiv:2606. 31399v1 Announce Type: new Abstract: Water looks unchanged as it warms, then at a critical point it boils.
arXiv Computation and Language
Sep 10
Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective
arXiv:2510.15047v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) as agents often fail to improve in new environments. We identify and characterize a failure mode we call explora...
arXiv AI
Jul 21
Masked Diffusion Language Models are Strong and Steerable Text-Based World Models for Agentic RL
arXiv:2607. 16204v1 Announce Type: new Abstract: Recent growth in reinforcement learning (RL) has surfaced a need for diverse, specialized training environments.
arXiv AI
Jun 19
Reward as An Agent for Embodied World Models
arXiv:2606. 19990v1 Announce Type: new Abstract: While RL has become a promising tool for refining world models, existing methods largely rely on conservative rollouts near the training distribution, limiting exploration, behavioral diversity, and richer dynamic discovery.
arXiv AI
3d ago
Beyond Prediction: Steering VLM Agents with Retrospective World Modeling
The paper introduces Retrospective World Modeling, a new paradigm for vision‑language‑model (VLM) agents that allows them to reason backward by estimating which action most likely caused a state transition. It proposes the Self‑Consistency Reward (SCR), an intrinsic signal that measures how well a policy action aligns with this retrospective explanation, providing dense transition‑level feedback. Experiments demonstrate that incorporating SCR improves policy robustness and generalization compared to purely prospective world‑modeling approaches.
arXiv AI
Aug 25
Reward-Free Continual Adaptation for Resilient Space Robots
The paper presents a reward‑free continual learning framework for space robots that uses latent‑state world models to adapt to severe hardware degradation. By pre‑training a model‑based agent in diverse simulations, the world model learns to predict reward structure in latent space. During deployment, the observation encoder and reward predictor are frozen while only the transition dynamics are updated via unsupervised rollouts, allowing the policy to adapt using imagined trajectories without new rewards.