arXiv AI
Oct 2

Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States

Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States introduces PoS, an inference-time framework that builds and maintains explicit belief states to guide large language model agents. Each belief state combines an estimate of the current world with unresolved task requirements, making clear what the agent still needs to learn and accomplish. PoS validates consistency, monitors task progress to detect Belief Trapping, and tailors recovery to the trapping pattern and unresolved requirements, achieving top performance across four benchmarks with all three LLM backbones.

By Yu Luo, Jiamin Jiang, Yimin Zuo, Xidao Wen, Rongchen Gao, Yongqian Sun, Shenglin Zhang, Guiyang Liu, Cheng Zhang, Fang Situ, Qi Zhou, Dan Pei
arXiv Computation and Language
Oct 21

LAMB: Latent Multi-Hypothesis Beliefs for Long-Horizon Large Language Agents

The paper introduces LAMB, a recurrent framework that stores latent multi‑hypothesis beliefs for long‑horizon language agents. LAMB separates a shared Common state containing interaction evidence from weighted Delta components representing competing hypotheses, and updates these hypotheses using relative evidence from action‑outcome predictions without generating textual memory. Experiments on ALFWorld, BabyAI, ScienceWorld, and Crafter show that LAMB matches or surpasses prior methods, notably improving success rates and reducing redundant actions.

By Peien Ding, Hui Li, Yuhan Liu, Jinsong Su