arXiv AI
Physics: Benchmarking Foundation Models on University-Level Physics Problem Solving
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 28
PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?
PhysElite is a new bilingual multimodal benchmark designed to evaluate large language models on Olympiad-level physics problems. It contains 11,586 problems, each paired with visual diagrams, step-by-step bilingual Chinese‑English solution derivations, and the final answer. Benchmarking 18 models revealed that even the best reaches only 33.7% accuracy, and a step‑level analysis highlights where models falter in reasoning.
arXiv AI
Jul 7
Reason, Reward, Refine: Step-Level Errors Corrections with Structured Feedback for Physics Reasoning in Small Language Models
arXiv:2607. 05199v1 Announce Type: new Abstract: Physics reasoning fails structurally in small language models: an error at any step propagates forward, corrupting every inference that follows.
arXiv Computation and Language
Oct 26
PHYRD: A Living Benchmark for Reproducing and Extending Theoretical Physics Research
arXiv:2610.32575v1 Announce Type: new Abstract: Large language models and agents have shown significant power in advanced physical research. In this paper, We introduce PHYRD, a living benchmark for...
arXiv Computation and Language
Sep 15
PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
arXiv:2609.13152v1 Announce Type: new Abstract: Large language models (LLMs) perform strongly on static science benchmarks, yet their ability to reason about the physical world through active experim...
arXiv AI
Jul 17
Assessing AI in Introductory Physics Problem Solving
arXiv:2607. 14303v1 Announce Type: cross Abstract: Reasoning or inference-scaling models are the new generation of Large Language Models (LLMs) capable of complex problem solving.
arXiv Computation and Language
Oct 27
LLMs Can Tackle High Energy Theoretical Physics, yet Gaps Remain: Part I, Quantum Field Theory
arXiv:2610.33134v1 Announce Type: cross Abstract: Beyond math and code, Large language models (LLMs) are beginning to tackle problems that have traditionally required substantial training for theoret...