arXiv AI

Compute-optimal data scaling for neural surrogates via multi-fidelity training

arXiv AI
Jun 26

Error-Conditioned Neural Solvers

arXiv:2606. 27354v1 Announce Type: cross Abstract: Neural surrogate models offer fast approximate mappings from PDE parameters to solutions, but they typically treat solving as a purely statistical task: once trained, they struggle to correct their own constraint violations and extrapolate beyond the training distribution.

By Haina Jiang, Liam Wang, Peng-Chen Chen, Min Seop Kwak, Seungryong Kim, Brian Bell, Jeong Joon Park
arXiv Machine Learning
Oct 8

Cross-Domain Pretraining for Steady-State Neural CFD Surrogates

The paper presents cross‑domain pretraining for neural surrogates in steady‑state computational fluid dynamics (CFD). By training models across varied geometries, boundary conditions, and fidelities, the authors show that such pretraining improves zero‑ and few‑shot performance compared to training from scratch or transferring from domain‑specific experts. Finetuning a pretrained cross‑domain model can reduce errors by 2–3× at the same sample size and require eight times fewer samples to reach the same error, with benefits that grow with model size and dataset diversity.

By Anthony Zhou, Amir Barati Farimani, Shirley Ho, Rudy Morel
arXiv Machine Learning
Sep 25

Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.

By Andreas E. Robertson, Ashley T. Lenau, John D. Shimanek, Benjamin A. Jasperson, Vivek Oommen, David L. Damm, Krishna Garikipati, Remi Dingreville