arXiv:2510. 25306v3 Announce Type: replace Abstract: Partial physical knowledge--governing structures known, constitutive relations or their combinations not--pervades spatiotemporal systems.
By Xizhe Wang, Xiaobin Song, Hongbo Zhao, Qingshan Jia, Qianchuan Zhao, Hao Sun, Benben Jiang
The paper investigates how LLaMA 3.1‑8B models numerical sequence patterns, focusing on time‑series prediction. By designing a task that requires detecting structural cues—specifically first differences in a sequence—the authors show that the model performs well and internally computes and stores these differences. Probing and activation‑patching experiments reveal that LLaMA retrieves and applies the first‑difference via an induction‑like circuit, marking one of the first demonstrations of concept induction in large language models.
By Rahul Chowdhury, Timothy A Rupprecht, Senhao Cao, Jiahao Liu, Octavia Camps, David Bau, Pu Zhao, Yanzhi Wang
The paper introduces a framework that separates physical modeling from execution in physics reasoning tasks. It uses a two‑stage post‑training approach: supervised fine‑tuning to build structured models and reinforcement learning with rubric‑based feedback to refine them. Experiments on PhysReason, PhyX, and SeePhys show that this explicit modeling improves reasoning performance by about 3% on average for small LLMs.
By Ye Zhang, Xuehang Guo, Rui Pan, Pengfei Yu, Denghui Zhang, Manling Li, Qingyun Wang
arXiv:2605. 29283v2 Announce Type: replace-cross Abstract: Recent physics foundation models claim general spatiotemporal forecasting ability, yet their evaluations often collapse performance into a single average score under a fixed training distribution.
By Mengdi Chu, Yang Liu, Ayan Biswas, Han-Wei Shen
The paper proposes an unsupervised learning approach that uses program synthesis to translate detailed simulation traces into sparse, high‑level structural patterns, making them easier for large language models to interpret. These pattern detectors can be guided by human‑provided labels such as "rigid collision" or "stretching spring" and produce transparent, explainable functions mapping system states to concise annotations. Experiments on a physics benchmark show that the annotated representations improve natural language reasoning about specific physical systems and enable natural‑language goals to be converted into reward programs for solution search.
By Sean Memery, Kartic Subr
arXiv:2503.19081v2 Announce Type: replace
Abstract: Scientific foundation models (SciFMs) aim to learn generalizable representations of physical systems governed by partial differential equations (PD...
By Serge Kotchourko, Amin Totounferoush, Michael W. Mahoney, Steffen Staab