arXiv AI

Crystalite: A Lightweight Transformer for Efficient Crystal Modeling

arXiv:2604. 02270v2 Announce Type: replace-cross Abstract: Generative models for crystalline materials often rely on equivariant graph neural networks, which capture geometric structure well but are costly to train and slow to sample.

arXiv Machine Learning
Sep 17

Robust and Efficient AI Frameworks for Scalable Material Design and Property Prediction

The thesis presents AI frameworks that accelerate crystalline materials discovery by tackling both crystal property prediction and crystal structure generation. It introduces CrysXPP, CrysGNN, and CrysMMNet for efficient, data‑sparse property prediction using graph autoencoding, self‑supervised pretraining, and multimodal learning. For generation, TGDMat is a text‑guided diffusion model that jointly learns lattice parameters, atomic types, and coordinates, enabling valid, stable, and conditionally generated periodic materials.

By Kishalay Das
arXiv Machine Learning
Sep 23

Deep Generative Crystal Structure Prediction: A Benchmark Study and a Controlled Test of Prototype Dependence

The study benchmarks 12 deep generative crystal structure prediction models against the template-based TCSP 2.0 on 180 test structures, finding that template retrieval achieves the highest top‑1 success (68.3%). Most generative predictions overlap with template substitutions, and removing entire stoichiometric prototype families from training reduces accuracy by 50‑78%, indicating strong prototype dependence. Only a small subset of predictions remain after such removal, suggesting limited genuine de‑novo capability.

By Lai Wei, Rongzhi Dong, Ying Feng, Madeline Miklos, Jianjun Hu
arXiv Machine Learning
Sep 17

ADAPT: Lightweight, Long-Range Machine Learning Force Fields Without Graphs

The paper introduces ADAPT, a lightweight machine‑learning force field that replaces graph neural networks with a direct coordinates‑in‑space Transformer encoder to model all pairwise atomic interactions. Applied to silicon point defects, ADAPT reduces force prediction error by about 22% and energy prediction error by roughly 40% compared to a state‑of‑the‑art GNN model, while also cutting computational cost. This approach addresses common GNN issues such as oversmoothing, oversquashing, and poor long‑range interaction representation, which are especially problematic for point defect modeling.

By Evan Dramko, Yihuang Xiong, Yizhi Zhu, Geoffroy Hautier, Thomas Reps, Christopher Jermaine, Anastasios Kyrillidis
arXiv AI
Sep 11

uFlowCSP: Crystal Structure Prediction using Mean flow generative models

uFlowCSP is a MeanFlow-based crystal structure prediction model that learns the average probability‑flow velocity, enabling it to generate complete crystal structures in one to five network evaluations. It achieves inference speeds 5×–58× faster than diffusion and flow‑matching methods while matching or surpassing their performance, with a chemistry‑ and symmetry‑aware Transformer that uses canonical atom ordering and per‑token chemistry embeddings. On the MP‑20 benchmark, uFlowCSP attains comparable or higher accuracy with far fewer evaluations and significantly lower wall‑clock time, demonstrating improved accuracy per network evaluation.

By Sourin Dey, Dipannoy Das Gupta, Lai Wei, Sadman Sadeed Omee, Jianjun Hu
arXiv Machine Learning
Jul 15

SinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems

arXiv:2607. 12380v1 Announce Type: new Abstract: Small molecules, crystals, and proteins all reduce to atoms in 3D space, yet their generative pipelines remain fragmented across domains, each with its Small molecules, crystals, and proteins all reduce to atoms in 3D space, yet their generative pipelines remain fragmented across domains, each with its own graph, equivariant, or frame-based architecture.

By Yuxuan Ren, Fan Yang, Jianhua Yao, Yatao Bian