arXiv AI
Jun 29
Grounded Iterative Language Planning: How Parameterized World Models Reduce Hallucination Propagation in LLM Agents
arXiv:2606. 27806v1 Announce Type: new Abstract: World models for language agents come in two useful forms.
LLM-BabyBench: Can Language Models Plan in Worlds They Can Simulate?
LLM‑BabyBench transforms the BabyAI gridworld into a fully observable, purely textual setting that isolates planning as the sole source of failure. By serialising the entire grid, providing formal instructions, and validating actions deterministically, the benchmark introduces the PPD suite—Predict, Plan, and Decompose tasks—each scored with metrics that separate mission understanding from sequencing. Across a range of large language models, simulation accuracy is high while planning success drops sharply beyond a model‑specific horizon, revealing that plan length—not grid size—drives failure and that models often commit to a single corridor‑shaped route without backtracking.
Related stories
arXiv AI
Oct 23
Steering Black-Box Large Language Model Agents with Pitfall Anticipation World Model
The paper introduces the Pitfall Anticipation World Model (PAWM), a selective guidance system for black-box large language model agents. PAWM predicts imminent failures in a bounded multi-step future and intervenes only when a potential pitfall is detected, reducing costly and often uninformative step-by-step predictions. Trained first with supervised fine-tuning on synthetic pitfall-labeled data and then co-trained with a black-box LLM, PAWM boosts Claude Sonnet 4.5’s performance by 24.3% on ScienceWorld and 7.7% on WebArena-Lite, outperforming several baselines.
arXiv AI
Jun 3
A Close Look At World Model Recovery In Supervised Fine-Tuned LLM Planners
arXiv:2606. 03685v1 Announce Type: cross Abstract: Supervised fine-tuning (SFT) improves end-to-end classical planning in large language models (LLMs), but do these models also learn to represent and reason about the planning problems they are solving?
arXiv AI
Oct 5
Keeping JEPA World Models Plannable When Little of the Frame Moves
The paper introduces SLIM, a pushing benchmark that tests language‑based goal specification for latent world models. It shows that a vanilla LeWM fails almost entirely due to an action‑insensitive encoder, but adding an inverse‑dynamics auxiliary loss restores encoder sensitivity and dramatically improves success rates. With the repaired latent, a lightweight language‑goal head can plan from natural language sentences, achieving high performance on navigation and pushing tasks without retraining the world model.
arXiv AI
Sep 25
GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI
GRASP is a multi-stage planning framework that improves the reliability of large language models on complex tasks. It separates planning into three specialized modules—GenPlan for global macro-guidelines, RevPlan for exploring localized strategies, and VerPlan for multi-criteria evaluation—allowing context isolation and strict macro-regularization. Experiments show GRASP outperforms direct LLM planners by significant margins on datasets such as Natural Plan Calendar Scheduling, ZebraLogic, and SciBench Math, and it mitigates performance collapse in multi-task and dual-task settings.
arXiv AI
Sep 24
Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms
The paper introduces VHD-Play, a pipeline that first samples and solves a mathematical model before generating agentic reinforcement learning environments, ensuring that dynamics and evaluation are aligned from the outset. This approach yields 3,300 diverse environments at a low cost and significantly improves the performance of a large language‑model agent (Qwen3.6‑35B‑A3B) across multiple diagnostic families and external benchmarks. The study demonstrates that stateful interaction is a key factor in learning gains and that scaling the training substrate can further enhance performance.
Hugging Face Trending Papers
Jun 19
Training the Orchestrator: A Supervised Approach to End-to-End PDDL Planning with LLM Agents
Translating natural-language planning intent into verified plans is a longstanding challenge: people communicate goals in language, while classical planners require formal PDDL specifications. Recent agentic frameworks bridge this gap by orchestrating a pool of specialized repair agents inside a verifier-checked refinement loop, but the orchestrator at the centre is itself a prompted frontier LLM, paying a frontier-LLM API call at every refinement step.
arXiv AI
Oct 31
Seq@K: Evaluating Language Models Under Sequential Feedback
Seq@K is a new evaluation protocol that measures a language model’s ability to solve a problem within K sequential attempts, receiving feedback after each failure. It isolates the core capability of iterative refinement from feedback, contrasting with existing metrics like Pass@K that do not capture this behavior. Experiments on seven benchmarks and sixteen frontier models show that Seq@K can change model rankings, reveal more efficient configurations, and provide insights into how models use feedback.
Hugging Face Trending Papers
Sep 24
GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI
GRASP is a multi-stage planning framework that separates planning into specialized modules: GenPlan for global macro-guidelines, RevPlan for exploring localized strategies, and VerPlan for multi-criteria evaluation. This strategy-aware approach yields state‑of‑the‑art accuracy on diverse datasets, outperforming direct LLM planners by up to 30.8% on ZebraLogic and reducing multi‑task degradation. GRASP’s context isolation and macro‑regularization also give it a 14.5% edge over frontier reasoning models like GPT‑5‑mini.
arXiv AI
Oct 9
Plan-and-Patch: Diffusion Language Models for Agentic Planning
Plan-and-Patch is a plan‑and‑act framework that uses a diffusion language model to generate structured, program‑like plans and then repairs them by filling in selected regions while keeping the surrounding steps fixed. The approach avoids regenerating entire plans, reducing unnecessary changes. Experiments show that on the Natural Plan benchmark, diffusion planners achieve a 53.7% plan‑repair success rate versus 27.0% for autoregressive planners, and after task‑specific training on ALFWorld and TextCraft, diffusion planners match autoregressive planners in plan generation success while cutting mean plan‑generation latency by 39–46%.
arXiv AI
Jul 21
SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planning
arXiv:2607. 17973v1 Announce Type: new Abstract: Latent world models have emerged as a powerful planning paradigm by learning action-conditioned predictive dynamics and using them as internal simulators to imagine and evaluate candidate action sequences.
arXiv AI
Sep 30
Do LLM Agents Execute the Plans They Declare? From Planning-Mode Declaration to Pattern-Specific Execution
arXiv:2609.38108v1 Announce Type: new Abstract: Large language models (LLMs) enable agents to solve long-horizon tasks by generating a plan and then executing it in an environment. However, successfu...