arXiv AI

When Planning Problems Become Hard for LLMs: Separating Structural Complexity from Semantic Interpretability

arXiv:2610. 26964v1 Announce Type: new Abstract: Large language models (LLMs) struggle with classical planning, but benchmarks rarely distinguish structural difficulty from the difficulty of interpreting symbolic vocabulary.

arXiv AI
Sep 25

GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI

GRASP is a multi-stage planning framework that improves the reliability of large language models on complex tasks. It separates planning into three specialized modules—GenPlan for global macro-guidelines, RevPlan for exploring localized strategies, and VerPlan for multi-criteria evaluation—allowing context isolation and strict macro-regularization. Experiments show GRASP outperforms direct LLM planners by significant margins on datasets such as Natural Plan Calendar Scheduling, ZebraLogic, and SciBench Math, and it mitigates performance collapse in multi-task and dual-task settings.

By Arunabh Srivastava (Amir), Mohammad A. (Amir), Khojastepour, Srimat Chakradhar, Sennur Ulukus
Hugging Face Trending Papers
Sep 24

GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI

GRASP is a multi-stage planning framework that separates planning into specialized modules: GenPlan for global macro-guidelines, RevPlan for exploring localized strategies, and VerPlan for multi-criteria evaluation. This strategy-aware approach yields state‑of‑the‑art accuracy on diverse datasets, outperforming direct LLM planners by up to 30.8% on ZebraLogic and reducing multi‑task degradation. GRASP’s context isolation and macro‑regularization also give it a 14.5% edge over frontier reasoning models like GPT‑5‑mini.

arXiv Computation and Language
Sep 14

LLM-BabyBench: Can Language Models Plan in Worlds They Can Simulate?

LLM‑BabyBench transforms the BabyAI gridworld into a fully observable, purely textual setting that isolates planning as the sole source of failure. By serialising the entire grid, providing formal instructions, and validating actions deterministically, the benchmark introduces the PPD suite—Predict, Plan, and Decompose tasks—each scored with metrics that separate mission understanding from sequencing. Across a range of large language models, simulation accuracy is high while planning success drops sharply beyond a model‑specific horizon, revealing that plan length—not grid size—drives failure and that models often commit to a single corridor‑shaped route without backtracking.

By Idriss Malek, Omar Choukrani, Daniil Orel, Anh Duy Le Dinh, Zhuohan Xie, Zangir Iklassov, Martin Tak\'a\v{c}, Salem Lahlou
arXiv Computation and Language
Oct 23

MemPlan: Memory-Conditioned PDDL Planning for Partially Observable Text Environments

MemPlan is a memory‑conditioned PDDL planning framework designed for partially observable interactive text environments. It keeps the PDDL domain fixed and reconstructs the problem at each step using parsed observations, candidate hypotheses, and interaction memory, employing positive graph memory to assign relevance‑based action costs and negative memory to record refuted assumptions as exclusion constraints. Experiments on TextWorld, ALFWorld, and Robotouille demonstrate that MemPlan improves task completion and step efficiency over language‑only and PDDL‑aware baselines while significantly reducing online token cost compared with LLM‑planning baselines such as ReAct, and its fine‑tuned interface generalizes across task types without task‑specific fine‑tuning.

By Tengwei Song, Robert Hoehndorf
arXiv AI
Oct 28

Does The Way You Plan Matter? An Empirical Study of Planning Representations for LLM Web Agents

The paper investigates how different natural language plan representations affect the performance of large language model (LLM) web agents. Using the PlanAhead framework, the authors automatically classify WebArena tasks into three difficulty levels and evaluate four plan types—sequential subgoals, narrative, pseudocode, and checklist—on hard tasks across multiple multimodal LLM agents. They introduce a decomposition of Success Rate into Achievement Rate and Solved-Task Consistency to better understand stochastic variability, finding that both plan formulation and the LLM used to generate the plan significantly influence agent robustness and success.

By Alejandra Zambrano, Sara Vera Marjanovic, Imene Kerboua, Xing Han L\`u, Leila Kosseim