arXiv Machine Learning

Reformulating Neural Operators in $d+1$ Dimensions for Embedding Evolution

arXiv:2505. 11766v4 Announce Type: replace Abstract: Neural Operators (NOs) are powerful architectures for learning mappings between function spaces.

arXiv Machine Learning
Aug 24

Shared Physics Responses Recover Hidden Rankings in Neural Operator Libraries

The paper introduces a method for selecting the best neural‑operator model during deployment without needing high‑fidelity reference solutions. By using a squared Hilbert‑space loss, the authors show that ranking a finite library of models depends only on the low‑dimensional span of candidate differences, enabling simultaneous scoring of all models with a single anchor‑based linearized response of the governing equation. This shared physical diagnostic accurately recovered over 99.6% of pairwise preferences and 99.0% of optimal checkpoints across diverse Fourier and convolutional operator libraries for fluid, reaction‑diffusion, and wave dynamics, and often outperformed the best individual candidates.

By Hanbing Liang, Fujun Liu
arXiv Machine Learning
Aug 11

Test-time Generalization for Physics through Neural Operator Splitting

arXiv:2602. 00884v2 Announce Type: replace Abstract: Neural operators have shown promise in learning solution maps of partial differential equations (PDEs), but they often struggle to generalize when test inputs lie outside the training distribution, such as novel initial conditions, unseen PDE coefficients or unseen physics.

By Louis Serrano, Jiequn Han, Edouard Oyallon, Shirley Ho, Rudy Morel
arXiv Machine Learning
Jul 8

Kernel-based Operator Learning: Error Analysis, Budget Allocation, and a Physics-Informed Extension

arXiv:2607. 06287v1 Announce Type: cross Abstract: We study kernel-based operator learning in a two-stage sampling framework, where an offline kernel regression operator learns a discretized representation of the target operator from input-output pairs and an online kernel reconstruction operator recovers the output function from predicted observations.

By R\"udiger Kempf
arXiv Machine Learning
Sep 25

Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.

By Andreas E. Robertson, Ashley T. Lenau, John D. Shimanek, Benjamin A. Jasperson, Vivek Oommen, David L. Damm, Krishna Garikipati, Remi Dingreville