arXiv AI
Towards a Belief-Based World Model for LLM Agents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Oct 21
Ask the World Before Acting: Environment Probing for Calibrating Agent World Models
arXiv:2606.31422v3 Announce Type: replace Abstract: Long-horizon language agents enable autonomous decision-making in complex environments by planning and executing sequences of interdependent action...
arXiv AI
Sep 11
Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability
The paper introduces the Belief-State Engine (BSE), an inference module that supplies a large language model (LLM) with a Bayesian posterior over hidden states in a partially observable Markov decision process (POMDP). By keeping the raw action‑observation log hidden from the LLM, the BSE ensures the agent behaves as a sound Markov policy on the belief MDP, thereby inheriting classical POMDP optimality guarantees. Experiments on the Tiger POMDP and a red‑team attack‑graph task show that BSE‑augmented agents outperform six baselines in task return, belief calibration, and decision consistency.
arXiv AI
Oct 23
Steering Black-Box Large Language Model Agents with Pitfall Anticipation World Model
The paper introduces the Pitfall Anticipation World Model (PAWM), a selective guidance system for black-box large language model agents. PAWM predicts imminent failures in a bounded multi-step future and intervenes only when a potential pitfall is detected, reducing costly and often uninformative step-by-step predictions. Trained first with supervised fine-tuning on synthetic pitfall-labeled data and then co-trained with a black-box LLM, PAWM boosts Claude Sonnet 4.5’s performance by 24.3% on ScienceWorld and 7.7% on WebArena-Lite, outperforming several baselines.
arXiv AI
Jun 30
Self-Evolving World Models for LLM Agent Planning
arXiv:2606. 30639v1 Announce Type: new Abstract: World models offer a principled way to equip long-horizon LLM agents with foresight: predictions of action consequences before execution.
arXiv AI
Jun 3
A Close Look At World Model Recovery In Supervised Fine-Tuned LLM Planners
arXiv:2606. 03685v1 Announce Type: cross Abstract: Supervised fine-tuning (SFT) improves end-to-end classical planning in large language models (LLMs), but do these models also learn to represent and reason about the planning problems they are solving?
arXiv AI
Jul 7
ASK in the Dark: Uncertainty-Gated LLM Assistance under Partial Observability
arXiv:2607. 02686v1 Announce Type: new Abstract: Reinforcement learning agents operating under partial observability must act on incomplete information, making them natural candidates for guidance from small language models (SLMs) that carry broad reasoning priors.