arXiv AI By Jiamei Jiang, Jiajing Zhang, Feifei Mo, Linjing Li, Daniel Zeng

Toward Secure and Reliable PDDL Formalization of Large Language Models with Planner-in-the-Loop Feedback

Read the original on arXiv AI →

arXiv:2606. 29700v1 Announce Type: new Abstract: Planning often requires symbolic specifications that are both executable and verifiable.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 11

Grounded Evaluation and Repair for NL-to-PDDL Problem Generation

The paper presents an end‑to‑end pipeline for translating natural language planning descriptions into PDDL problem instances using large language models. It incorporates multiple checks—syntactic parsing, planner success, domain conformance, an LLM critic, and iterative repair—to ensure faithfulness to the original task. Experiments on Planetarium, AutoPlanBench, and curated PDDL~2.1 problems reveal that operational success can diverge from benchmark‑reference reconstruction, and that structured repair improves outcomes while PDDL~2.1 remains challenging for reference reconstruction.

By Joana Rosa, Pedro Santos, Valdemar Oliveira, Rom\~ao Silva, L. Miguel Silveira, Bruno Martins
arXiv AI
Sep 24

Provably Complete Generalized Planning with LLMs

The paper presents a method for automatically generating generalized plans in Lean, along with formal proofs of their completeness for given domain constraints. It introduces a semantic‑preserving conversion from PDDL to Lean and uses an LLM to produce both the plan and its proof, whose correctness is verified by Lean’s kernel. Evaluated on 13 benchmark domains with GPT‑5.6‑Sol, the approach yields complete plans and valid proofs for 12 of them, marking a significant advance in automated generalized‑plan completeness.

By Katharina Stein, Chaahat Jain, J\"org Hoffmann, Alexander Koller
arXiv AI
Aug 19

LLM-Only PDDL Domain Repair with Open-Weight Models

The paper evaluates how well open-weight large language models can repair Planning Domain Definition Language (PDDL) models using only LLMs. Experiments show that while the best LLM achieves an F1 score of 0.87—an improvement of 0.38 over a symbolic baseline—it still fails to reliably satisfy test constraints, with a mean test pass rate of only 0.82 and as low as 0.06 on the Thoughtful domain. The study concludes that current open-weight models cannot guarantee the necessary test constraint satisfaction for dependable automated model repair.

By Nader Karimi Bavandpour, Pascal Bercher