arXiv Machine Learning By Tobias Kreiman, Yutong Bai, Fadi Atieh, Elizabeth Weaver, Eric Qu, Aditi S. Krishnapriyan

Transformers Discover Molecular Structure Without Graph Priors

Read the original on arXiv Machine Learning →

The paper investigates whether machine learning models can uncover physical patterns in atomistic data without relying on traditional physics-based inductive biases such as geometric locality or graph structures. By training a general-purpose architecture on molecular simulation data, the authors demonstrate that the model autonomously learns interatomic interaction strengths resembling classical electrostatics and identifies interaction cutoffs aligned with established physical models. The study also reports predictable neural scaling behavior and competitive accuracy on certain metrics compared to physics-informed architectures, suggesting that explicit priors may only be necessary when empirically justified.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jul 7

Out-of-distribution Neural Inference in Dynamical Ising Models

arXiv:2607. 03039v1 Announce Type: new Abstract: Neural networks are increasingly used to infer hidden physical structure from dynamical observations, yet it remains unclear whether their out-of-distribution performance reflects transferable physical rule learning.

By Yuan-Bin Zhu, Shuang Qiao, Shi-Ju Ran
arXiv Machine Learning
Sep 17

ADAPT: Lightweight, Long-Range Machine Learning Force Fields Without Graphs

The paper introduces ADAPT, a lightweight machine‑learning force field that replaces graph neural networks with a direct coordinates‑in‑space Transformer encoder to model all pairwise atomic interactions. Applied to silicon point defects, ADAPT reduces force prediction error by about 22% and energy prediction error by roughly 40% compared to a state‑of‑the‑art GNN model, while also cutting computational cost. This approach addresses common GNN issues such as oversmoothing, oversquashing, and poor long‑range interaction representation, which are especially problematic for point defect modeling.

By Evan Dramko, Yihuang Xiong, Yizhi Zhu, Geoffroy Hautier, Thomas Reps, Christopher Jermaine, Anastasios Kyrillidis
arXiv AI
Jun 2

Towards a Physics Foundation Model

arXiv:2509. 13805v4 Announce Type: replace-cross Abstract: Foundation models have revolutionized natural language processing through a ``train once, deploy anywhere'' paradigm, where a single pre-trained model adapts to countless downstream tasks without retraining.

By Florian Wiesner, Zo\"e J. Gray, Matthias Wessling, Stephen Baek