arXiv AI

Zatom-2: Multitask Pretraining on Atomistic Data for Generative Modeling across Domains

Zatom-2 is a multitask generative model for atomistic data that has been pretrained on about five million structures from the OMol25 and OMat24 datasets. It uses a multiscale Transformer with conditional flow matching to support tasks such as generation, structure prediction, and energy/force prediction for both molecules and materials. The model outperforms its predecessor, Zatom-1, on molecular distribution fidelity and benchmark generation tasks, and improves protein backbone designability from 67.8% to 74.8% after finetuning on 2,000 protein domains.

arXiv Machine Learning
Jul 1

ElemeNet: Multiscale Molecular Machine Learning with Uncertainty Quantification Across the Periodic Table

arXiv:2606. 30961v1 Announce Type: cross Abstract: Advances in deep learning architectures and representations have enabled ML-driven chemical property prediction, but state-of-the-art (SOTA) models have remained largely confined to independent codebases and lack support for diverse chemical species.

By Jacob W. Toney, Samir Darouich, Yiran Wang, Aaron G. Garrison, Johannes K\"astner, Heather J. Kulik
arXiv Machine Learning
Oct 3

A Large Scale Investigation of Scaling Limits in Chemical Language Models

The paper reports a large-scale, compute-controlled study of Chemical Language Models (CLMs) involving over 30,000 experiments across different molecular representations, tokenizations, model sizes, datasets, and architectures. It finds clear scaling trends in pretraining loss but shows that these improvements do not translate into proportional gains in goal-directed molecular design, with chemical syntax saturating early while semantic properties develop more slowly. The authors release a new suite of models, NovoMolGen, that achieves state-of-the-art results in drug discovery tasks, highlighting a disconnect between representation learning and downstream design and calling for new pretraining paradigms that target chemical semantics.

By Roshan Balaji, Kamran Chitsaz, Quentin Fournier, Nirav Pravinbhai Bhatt, Sarath Chandar
arXiv AI
Sep 30

Where Should Physics Enter a Molecular Crystal Generator?

The paper introduces CrystAF, an all‑atom crystal flow‑map generation model, and evaluates where physics should be incorporated into generative crystal structure models. By applying physics‑informed post‑training, the authors improve molecular validity and crystal packing without altering sampling speed, while inference‑time corrections further refine the structures. The study demonstrates that post‑training and inference‑time physics are complementary, and that the post‑training approach transfers to other generators such as Clari‑M and MolCrystalFlow.

By Haocheng Tang, Junmei Wang, Wengong Jin
arXiv Machine Learning
Jul 15

SinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems

arXiv:2607. 12380v1 Announce Type: new Abstract: Small molecules, crystals, and proteins all reduce to atoms in 3D space, yet their generative pipelines remain fragmented across domains, each with its Small molecules, crystals, and proteins all reduce to atoms in 3D space, yet their generative pipelines remain fragmented across domains, each with its own graph, equivariant, or frame-based architecture.

By Yuxuan Ren, Fan Yang, Jianhua Yao, Yatao Bian
arXiv AI
Sep 17

BOOM: Benchmarking Out-Of-distribution Molecular Property Predictions of Machine Learning Models

BOOM is a new benchmark for evaluating out‑of‑distribution (OOD) molecular property predictions in machine learning. It provides chemically‑informed tests across common property prediction tasks and assesses over 150 model‑task combinations. The study shows that current models, including chemical foundation models, struggle to generalize OOD, with the best model still exhibiting three times higher error than in‑distribution predictions.

By Evan R. Antoniuk, Shehtab Zaman, Tal Ben-Nun, Peggy Li, James Diffenderfer, Busra Sahin, Obadiah Smolenski, Everett Grethel, Tim Hsu, Anna M. Hiszpanski, Kenneth Chiu, Bhavya Kailkhura, Brian Van Essen
arXiv Machine Learning
Jul 7

AquaGen: Scaling generative models to molecular dynamics precision on thousands of atoms

arXiv:2607. 03513v1 Announce Type: cross Abstract: We present AquaGen, the first all-atom, explicit solvent, periodic-boundary-condition-aware generative model that produces molecular configurations from the Boltzmann distribution at a fraction of the cost of molecular dynamics (MD).

By Emmanuel Bengio, Sanjeev Raja, Yui Tik Pang, Kerstin Klaeser, Cristian Gabellini, Nikhil Shenoy, Francesco Di Giovanni, Prudencio Tossou
arXiv Machine Learning
Jul 22

GEqTrain: A Configuration-Driven Framework for Retargeting Equivariant Graph Neural Networks Across 3D Scientific Tasks

arXiv:2607. 19083v1 Announce Type: new Abstract: Equivariant graph neural networks provide a powerful modeling language for three-dimensional scientific data, but their reuse is often limited by implementations tied to specific tasks, outputs, and training regimes.

By Daniele Angioletti, Marco Nobile, Vittorio Limongelli
arXiv Machine Learning
Jul 23

OrbitAll: A Unified Quantum Mechanical Representation Deep Learning Framework for All Molecular Systems

arXiv:2507. 03853v2 Announce Type: replace Abstract: We introduce OrbitAll, a geometry- and physics-informed deep learning framework that encodes any molecular system with arbitrary charges, spins, and environmental effects using electronic structure information.

By Beom Seok Kang, Vignesh C. Bhethanabotla, Amin Tavakoli, Maurice D. Hanisch, Arimitsu Horikawa-Strakovsky, Miguel Nouman, Danish Khan, William A. Goddard III, Anima Anandkumar