arXiv Machine Learning

Predicting Out-of-Distribution Generalization of Neural Operators via Observable Spectral Error Decomposition

arXiv:2609. 23529v1 Announce Type: new Abstract: Neural operators have emerged as powerful surrogates for solving partial differential equations (PDEs), yet their reliability under distribution shift remains a critical barrier to deployment.

arXiv AI
5d ago

WaSP: Wasserstein Data Synthesis Pipeline for Solver-Free Operator Learning

The paper introduces WaSP, a Wasserstein Data Synthesis Pipeline that trains neural operators on manufactured input‑solution pairs while progressively reducing distribution shift toward the target input distribution. By iteratively generating new pairs through a learned surrogate and the exact PDE operator, WaSP achieves a stepwise error‑propagation bound and empirically reduces solution error by 3.9× to 9.5× on PDE benchmarks such as Allen‑Cahn, Kuramoto‑Sivashinsky, and Ginzburg‑Landau.

By Ryan Liu, Chuwei Wang, Ricardo Baptista, Andrew Stuart, Anima Anandkumar
arXiv AI
Sep 30

Neural networks for spectral optimization

arXiv:2609.36047v1 Announce Type: cross Abstract: Given a functional dependent on the spectrum of a differential operator, we address the problem of finding a domain which optimizes this functional....

By Alexis de Villeroch\'e, Beniamin Bogosel, St\'ephane Breuils, Dorin Bucur, Jacques-Olivier Lachaud
arXiv AI
Jul 7

Learning to Discover Iterative Spectral Algorithms

arXiv:2602. 09530v2 Announce Type: replace-cross Abstract: We introduce AutoSpec, a neural network framework for discovering iterative spectral algorithms for large-scale numerical linear algebra and numerical optimization.

By Zihang Liu, Oleg Balabanov, Yaoqing Yang, Michael W. Mahoney
arXiv Machine Learning
Sep 17

Fast Learning Rates for Physics-Informed Kernel Methods

arXiv:2609. 18901v1 Announce Type: cross Abstract: In physics-informed machine learning, a target function $u^*$ is learned from noisy value observations $y_i=u^*(x_i)+ \varepsilon_i$, together with differential information, given either by noisy observations $d_j=(Du^*)(z_j)+\xi_j$ or by a known physical constraint $Du^*=v$.

By Luc Brogat-Motte, Joachim Bona-Pellissier, Giacomo Meanti, Lorenzo Rosasco
arXiv Machine Learning
Oct 8

Fluids You Can Trust: Property-Preserving Operator Learning for Incompressible Flows

The paper introduces a kernel‑based operator learning method that preserves key physical properties—such as incompressibility, periodicity, and turbulence—of the incompressible Navier–Stokes equations. By mapping input functions to expansion coefficients in a property‑preserving kernel basis, the method guarantees that predicted velocity fields analytically maintain these properties. The authors provide theoretical convergence guarantees, develop efficient computational techniques for large‑scale training, and demonstrate significant accuracy and speed improvements over neural operators on 2D and 3D flow benchmarks.

By Ramansh Sharma, Matthew Lowery, Houman Owhadi, Varun Shankar
arXiv Machine Learning
Sep 7

The Sample Complexity of Learning Lipschitz Operators with respect to Gaussian Measures

The paper investigates how many linear samples are needed to learn Lipschitz operators under Gaussian measures. It establishes both lower and upper bounds on the Hermite polynomial approximation error and shows that the minimal worst‑case error cannot converge algebraically with the number of samples. However, if the covariance operator of the Gaussian measure decays rapidly, convergence rates arbitrarily close to any algebraic rate can be achieved.

By Ben Adcock, Michael Griebel, Gregor Maier
arXiv Machine Learning
Aug 12

DEFT: Data-Efficient Frequency-domain Top-k Sampling via Inverse Discrete Fourier Transform for Spatiotemporal Dynamical Systems Modeling

arXiv:2608. 11019v1 Announce Type: new Abstract: Modeling spatiotemporal dynamical systems governed by partial differential equations (PDEs) poses two major challenges: it either requires expensive physics-based simulators that entail iterative numerical solving at high computational cost, or it depends on abundant training data, yet purely data-driven models often generalize poorly to downstream dynamic operating conditions.

By Hengbo Xiao, Jiale Liu, Jiahao Song, Guannan He