arXiv Machine Learning
Sep 21

Transformers Discover Molecular Structure Without Graph Priors

The paper investigates whether machine learning models can uncover physical patterns in atomistic data without relying on traditional physics-based inductive biases such as geometric locality or graph structures. By training a general-purpose architecture on molecular simulation data, the authors demonstrate that the model autonomously learns interatomic interaction strengths resembling classical electrostatics and identifies interaction cutoffs aligned with established physical models. The study also reports predictable neural scaling behavior and competitive accuracy on certain metrics compared to physics-informed architectures, suggesting that explicit priors may only be necessary when empirically justified.

By Tobias Kreiman, Yutong Bai, Fadi Atieh, Elizabeth Weaver, Eric Qu, Aditi S. Krishnapriyan
arXiv AI
Aug 26

Learning the Kohn-Sham map with neural operators for quasi-linear scaling density functional theory

The paper presents a neural operator that learns the Kohn–Sham map, directly predicting electron density from the Kohn–Sham potential without orbital diagonalization. Using a domain‑invariant SE(3)‑equivariant Fourier neural operator trained on 8,504 molecules and solids, the model achieves quasi‑linear scaling self‑consistent field (SCF) convergence across diverse systems—including organic molecules, insulators, and metals—while reproducing Kohn–Sham DFT accuracy for densities, spectra, and structural observables. This enables large‑scale simulations, such as magnesium dislocation densities with 82,500 valence electrons, on a single GPU.

By Danish Khan, Maurice D. Hanisch, Nikolai Argatoff, Evan Xie, Sandeep Sharma, Anima Anandkumar
arXiv Machine Learning
Jul 1

ElemeNet: Multiscale Molecular Machine Learning with Uncertainty Quantification Across the Periodic Table

arXiv:2606. 30961v1 Announce Type: cross Abstract: Advances in deep learning architectures and representations have enabled ML-driven chemical property prediction, but state-of-the-art (SOTA) models have remained largely confined to independent codebases and lack support for diverse chemical species.

By Jacob W. Toney, Samir Darouich, Yiran Wang, Aaron G. Garrison, Johannes K\"astner, Heather J. Kulik