From 1D Benchmarks to Complex 3D Geometries: Can Agents Reliably Specify Problems for Automated PDE Simulation?

The paper investigates whether AI agents can reliably generate complete, executable JSON specifications for automated PDE simulation, covering geometry creation, meshing, solving, and result export. Using a workflow that combines model extraction, deterministic scientific checks, clarification, and validated local patches, the authors evaluate specification correctness, execution completion, and numerical verification across 120 template-related requests. The approach achieves 98.3% correct first-turn specifications, outperforms schema-assisted and model-only baselines, and demonstrates successful automated execution in 30 complex 3D cases and 75% success in live user-to-results tests.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• agents
• benchmarks