arXiv Machine Learning

When Does Cheap Physics Help? Gated Multi-Fidelity Physics-Informed Networks with Provable Sample Savings and Conformal Guarantees

The paper investigates when inexpensive low‑fidelity (LF) physics models can reduce the number of costly high‑fidelity (HF) simulations needed for accurate solutions of parametric partial differential equations. It derives a sample‑complexity bound showing that learning the HF field via its discrepancy from the LF model can cut HF samples by a factor of κ^{2γ}, where κ is the complexity ratio and γ the effective‑dimension exponent, and confirms this scaling in a kernel setting. Guided by this theory, the authors introduce GaMF‑PINN, a gated multi‑fidelity physics‑informed neural network that selectively trusts the LF model and falls back to physics‑only learning when necessary, coupled with a conformal uncertainty procedure that guarantees coverage of the HF solution. The method is evaluated on the newly released MFPDE‑Bench, achieving HF‑PINN accuracy with up to eight times fewer HF solves, robustness to corrupted LF models, and reliable uncertainty estimates compared to Bayesian PINNs and deep ensembles.

arXiv Machine Learning
Jun 2

Taming the Loss Landscape of PINNs with Noisy Feynman-Kac Supervision: Operator Preconditioning and Non-Asymptotic Error Bounds

arXiv:2606. 00643v1 Announce Type: cross Abstract: Physics-Informed Neural Networks (PINNs) often train slowly or fail to converge on challenging partial differential equations (PDEs), a behavior recently linked to severely ill-conditioned loss landscapes inherited from the underlying differential operator.

By Nathanael Tepakbong, Hanyu Hu, Chengyu Liu, Xiang Zhou
arXiv Machine Learning
Sep 14

Physics-Informed Conformal Prediction: Embedding PDE Consistency into Distribution-Free Uncertainty Quantification for Neural Operators

Physics-Informed Conformal Prediction (PI‑CP) embeds PDE residuals into the nonconformity score of split conformal prediction, yielding distribution‑free prediction intervals with provable coverage that adapt spatially to physics violations. The method demonstrates consistent 89‑91% coverage across six physics scenarios, outperforming MC Dropout and Deep Ensembles, while Fourier Neural Operators (FNO) achieve superior accuracy over CNN and DeepONet. Additionally, the authors prove that FNO’s translation equivariance limits its ability to solve PDEs with Dirichlet boundary conditions, and show that adding coordinate channels can reduce error by up to 63×.

By Michael Chin
arXiv Machine Learning
Sep 22

Learning Physics from an Imperfect Ancestor

arXiv:2609.24947v1 Announce Type: new Abstract: Neural operators evaluate parametric partial differential equations cheaply but degrade sharply outside their training distribution. Physics-informed n...

By S. Mohammad Mousavi, Teeratorn Kadeethum, Nikolaos Bouklas, Somdatta Goswami
arXiv Machine Learning
Jun 5

When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains

arXiv:2605. 08318v2 Announce Type: replace Abstract: We study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures with learned attention outperform Fourier-domain neural operators.

By Brandon Yee, Pairie Koh, Jack Rodriguez, Mihir Tekal
arXiv Machine Learning
Jun 25

A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients

arXiv:2606. 24999v1 Announce Type: new Abstract: High-dimensional partial differential equations (PDEs) with unknown coefficients arise widely in scientific machine learning, including continuous-time reinforcement learning, yet solving them efficiently in a data-driven way remains challenging.

By Yanwei Jia, Du Ouyang, Huy\^en Pham, Xun Yu Zhou
arXiv Machine Learning
Oct 5

S$^{2}$-PINN: Stochastic Separable Physics-Informed Neural Networks

The paper introduces S$^{2}$-PINN, a stochastic separable physics-informed neural network that models the solution of random partial differential equations using a learnable Gaussian spatial dictionary, Fourier temporal features, and a generalized polynomial chaos stochastic basis linked by a low-rank Canonical Polyadic tensor core. Training employs a hybrid strong-form and gPC-projected residual loss, and theoretical analysis shows the separable class is dense in $L^2$ and that the projected residual matches a stochastic Galerkin constraint. Experiments on four manufactured benchmarks and additional Poisson, Darcy, Navier–Stokes, and inverse problems demonstrate that S$^{2}$-PINN achieves higher mean and variance accuracy, better calibration, and fewer parameters than nine baselines, supporting stochastic separability as an effective design principle for physics-informed neural UQ.

By Zhendong Li, Akwum Onwunta