arXiv Machine Learning

Non-Asymptotic Stability and Consistency Guarantees for Physics-Informed Neural Networks via Coercive Operator Analysis

The paper introduces a unified theoretical framework for analyzing the stability and consistency of Physics-Informed Neural Networks (PINNs) using operator coercivity, variational formulations, and non-asymptotic perturbation theory. It proves that minimizing residual losses in Sobolev norms leads to convergence in energy and uniform norms, provides deterministic stability bounds and probabilistic concentration results for sample complexity, and establishes a generalization bound linking residual consistency, projection error, and perturbation sensitivity. Empirical tests on elliptic, parabolic, and nonlinear PDEs validate the predictive accuracy of these theoretical bounds and highlight key structural principles such as operator coercivity, activation smoothness, and sampling admissibility.

arXiv Machine Learning
Sep 2

Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees

The paper presents a theoretical framework for certifying the accuracy of physics‑informed neural networks (PINNs) used to solve partial differential equations. It derives generalization bounds that link the residual loss minimized during training to the actual error in the solution space, showing that if the neural approximation stays within a compact subset, a vanishing residual guarantees convergence to the true solution. Deterministic and probabilistic convergence results are provided, offering explicit error guarantees based on residual, boundary, and initial condition errors.

By Amartya Mukherjee, Maxwell Fitzsimmons, David C. Del Rey Fern\'andez, Jun Liu
arXiv Machine Learning
Aug 27

StablePDENet: Enhancing Neural Operator Stability through Physics-Informed Residual-Sensitivity Regularization

The paper introduces StablePDENet, a physics-informed adversarial training framework that regularizes the residual sensitivity of neural operators to improve stability against input perturbations. The method formulates operator learning as a min–max optimization, where a physics-based projected‑gradient adversary generates perturbations and the outer objective combines the attacked physics loss with a normalized residual‑sensitivity penalty. Experiments on benchmark problems show that StablePDENet outperforms PI‑DeepONet and its adversarial variant in accuracy under adversarial attacks while maintaining competitive performance on clean data, and it also enhances generalization and highlights the distinction between model sensitivity and intrinsic operator ill‑conditioning.

By Chutian Huang, Chang Ma, Kaibo Wang, Yang Xiang
arXiv Machine Learning
Jun 25

A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients

arXiv:2606. 24999v1 Announce Type: new Abstract: High-dimensional partial differential equations (PDEs) with unknown coefficients arise widely in scientific machine learning, including continuous-time reinforcement learning, yet solving them efficiently in a data-driven way remains challenging.

By Yanwei Jia, Du Ouyang, Huy\^en Pham, Xun Yu Zhou
arXiv Machine Learning
Oct 9

Gen-PINNs: Generative Adversarial Physics Informed Neural Networks for solving partial differential equations

Gen-PINNs introduces a deterministic residual-adversarial framework that combines Generative Adversarial Networks with Physics-Informed Neural Networks to solve partial differential equations. The method addresses limitations of standard PINNs—such as spectral bias, loss imbalance, and optimizer stagnation—by using a generator that learns the PDE solution with dynamically weighted physics-informed losses and discriminators that assess residuals against zero-residual states. Experiments on nonlinear and higher-order PDEs (Burgers, Allen‑Cahn, Kuramoto‑Sivashinsky) show significant gains in accuracy and convergence, especially for sharp-front, stiff, and high-order problems.

By Muhammad M. Akmal, Kamy Sepehrnoori, Michael J. Pyrcz
arXiv Statistics ML
Sep 14

PDE-constrained inverse problems at the $\sqrt{n}$ rate via debiased physics-informed neural networks

The paper introduces a two‑step debiased estimation method for PDE‑constrained inverse problems where the PDE solution is approximated by Physics‑Informed Neural Networks (PINNs). By combining neural‑network‑based nonparametric estimation with an influence‑function bias correction, the authors achieve a √{n}-consistent, asymptotically normal estimator without undersmoothing the neural network. The approach is extended to Bayesian inference, yielding a posterior that contracts at the √{n}-rate with asymptotic covariance matching the frequentist estimator, and the analysis also provides near‑minimax rates for estimating nonparametric regression functions and their derivatives in Sobolev spaces.

By Yves Atchade, Debarghya Mukherjee
arXiv Machine Learning
Oct 2

The limits of exactness: On the failure of automatic differentiation in physics-informed machine learning

The article discusses how automatic differentiation (AD) enables neural networks to compute derivatives of governing equations to machine precision, forming the backbone of physics-informed machine learning. However, the author argues that numerical exactness does not guarantee physical fidelity, as AD lacks awareness of the physical structure a solution must satisfy. The paper highlights that many physical constraints—such as convection directionality, diffusion, dispersion, conservation, thermodynamic consistency, symmetry, symplectic structure, positivity, monotonicity, and boundedness—are overlooked by AD, suggesting a need to rethink how PDE-driven neural surrogates are built.

By Ameya D. Jagtap
arXiv Machine Learning
Jul 28

Global Convergence of DGM and PINN Algorithms for Solving Nonlinear PDEs

arXiv:2607. 24726v1 Announce Type: new Abstract: The Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) have become widely-used methods for solving partial differential equations (PDEs) in the rapidly growing field of scientific machine learning.

By Justin Sirignano, Konstantinos Spiliopoulos, Samuel Cohen
arXiv Machine Learning
Jun 5

On the training of physics-informed neural operators for solving parametric partial differential equations

arXiv:2606. 06164v1 Announce Type: new Abstract: Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data.

By Nanxi Chen, Chuanjie Cui, Airong Chen, Sifan Wang, Rujin Ma