FrontierPhysics: Evaluating Agents for End-to-End Physics Research

FrontierPhysics is a new end‑to‑end benchmark for AI agents in physics, comprising 56 tasks created by 42 physicists across nine domains of theoretical, computational, and experimental physics. Each task requires an agent to review literature, devise a research plan, conduct experiments, and produce structured outputs and manuscripts, with evaluation based on deterministic verifiers and expert rubrics. In tests of 22 models, none exceeded 46 of 168 rollouts, revealing that agents struggle mainly with rigorous reasoning and expert intuition rather than physics knowledge or execution.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• agents
• benchmarks