arXiv AI
Belief Embedding Tree Search
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
1d ago
From POMDP Theory to Deep RL with Particle Filters
arXiv:2610.27575v1 Announce Type: new Abstract: Model-based reinforcement learning in partially observable environments requires inferring hidden states, learning latent dynamics, and planning under...
arXiv AI
Sep 11
Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability
The paper introduces the Belief-State Engine (BSE), an inference module that supplies a large language model (LLM) with a Bayesian posterior over hidden states in a partially observable Markov decision process (POMDP). By keeping the raw action‑observation log hidden from the LLM, the BSE ensures the agent behaves as a sound Markov policy on the belief MDP, thereby inheriting classical POMDP optimality guarantees. Experiments on the Tiger POMDP and a red‑team attack‑graph task show that BSE‑augmented agents outperform six baselines in task return, belief calibration, and decision consistency.
arXiv AI
Jul 23
Sophisticated Policies from Epistemic Priors
arXiv:2607. 19518v1 Announce Type: new Abstract: Sophisticated Inference is a variant of active inference often associated with recursive belief modeling and tree search.
arXiv AI
Sep 30
Risk-Averse Online POMDP Planning via CVaR of the Immediate Cost with Performance Guarantees
arXiv:2609.35874v1 Announce Type: new Abstract: Online POMDP planners optimize the expected cumulative cost, which can mask dangerous states when the belief places significant mass on high-cost state...
arXiv AI
Sep 10
Power Mean Estimation in Stochastic Continuous Monte Carlo Tree Search
arXiv:2609.06489v1 Announce Type: cross Abstract: Monte Carlo Tree Search (MCTS) has demonstrated success in online planning for deterministic environments, yet significant challenges remain in adapt...
arXiv AI
Jun 19
VOiLA: Vectorized Online Planning with Learned Diffusion Model for POMDP Agents
arXiv:2606. 19729v1 Announce Type: cross Abstract: Planning under uncertainty is an essential capability for autonomous robots.