arXiv Computation and Language
PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
Oct 15
Words to World: Benchmarking LLMs in Interactive Physical Environments
arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that af...
arXiv Computer Vision
Oct 1
Asking the World: Generalist Physical Reasoning through Agentic World Modeling and Probing
arXiv:2609.39135v1 Announce Type: new Abstract: Physical reasoning from video requires inferring latent physical properties and dynamics beyond direct observation. Direct VLM inference remains unreli...
arXiv AI
Sep 28
PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?
PhysElite is a new bilingual multimodal benchmark designed to evaluate large language models on Olympiad-level physics problems. It contains 11,586 problems, each paired with visual diagrams, step-by-step bilingual Chinese‑English solution derivations, and the final answer. Benchmarking 18 models revealed that even the best reaches only 33.7% accuracy, and a step‑level analysis highlights where models falter in reasoning.
arXiv Computation and Language
Aug 25
Decoupled Physical Modeling and Execution for Physics Reasoning
The paper introduces a framework that separates physical modeling from execution in physics reasoning tasks. It uses a two‑stage post‑training approach: supervised fine‑tuning to build structured models and reinforcement learning with rubric‑based feedback to refine them. Experiments on PhysReason, PhyX, and SeePhys show that this explicit modeling improves reasoning performance by about 3% on average for small LLMs.
arXiv AI
3d ago
SpaceAct: Benchmarking 3D Spatial and Temporal Reasoning via Closed-Loop Action and Active Perception
SpaceAct is a new benchmark that tests multimodal large language models on 3D spatial and temporal reasoning through closed‑loop physical action and active perception. It uses interlocking bricks and mechanical puzzles to create 108 verified instances across 36 task families, requiring models to reconstruct 3D geometry, anticipate dynamics, and execute precise 6‑DoF poses while avoiding collisions. The accompanying SAPA framework provides diagnostic modes and active‑perception capabilities, revealing that even with a valid plan, current models struggle with 3D visual grounding and action refinement.
arXiv Machine Learning
Sep 2
DiscoverPhysics: Benchmarking LLMs for Out-of-the-Box Scientific Thinking
arXiv:2605.26087v2 Announce Type: replace-cross Abstract: Frontier LLMs now perform strongly across a wide range of physics evaluations, but it is hard to disentangle genuine reasoning from recall of...