arXiv Machine Learning

Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees

The paper presents a theoretical framework for certifying the accuracy of physics‑informed neural networks (PINNs) used to solve partial differential equations. It derives generalization bounds that link the residual loss minimized during training to the actual error in the solution space, showing that if the neural approximation stays within a compact subset, a vanishing residual guarantees convergence to the true solution. Deterministic and probabilistic convergence results are provided, offering explicit error guarantees based on residual, boundary, and initial condition errors.

arXiv Machine Learning
Oct 2

The limits of exactness: On the failure of automatic differentiation in physics-informed machine learning

The article discusses how automatic differentiation (AD) enables neural networks to compute derivatives of governing equations to machine precision, forming the backbone of physics-informed machine learning. However, the author argues that numerical exactness does not guarantee physical fidelity, as AD lacks awareness of the physical structure a solution must satisfy. The paper highlights that many physical constraints—such as convection directionality, diffusion, dispersion, conservation, thermodynamic consistency, symmetry, symplectic structure, positivity, monotonicity, and boundedness—are overlooked by AD, suggesting a need to rethink how PDE-driven neural surrogates are built.

By Ameya D. Jagtap
arXiv Machine Learning
Aug 27

Physics-Informed Error Field Learning: A Post-Training Optimization Framework for Physics-Informed Neural Networks

Physics-Informed Error Field Learning (PIEFL) is a post‑training optimization framework for Physics‑Informed Neural Networks (PINNs). After a primary network reaches satisfactory accuracy, PIEFL introduces an auxiliary error network that learns the discrepancy between the current approximation and the exact solution by deriving error control equations under physical constraints. The learned error correction is then combined with the primary prediction, improving solution accuracy without modifying the primary network architecture and focusing computational resources on correcting existing prediction errors.

By Jiuyun Sun, Yong Zhang
arXiv Machine Learning
Jul 28

Global Convergence of DGM and PINN Algorithms for Solving Nonlinear PDEs

arXiv:2607. 24726v1 Announce Type: new Abstract: The Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) have become widely-used methods for solving partial differential equations (PDEs) in the rapidly growing field of scientific machine learning.

By Justin Sirignano, Konstantinos Spiliopoulos, Samuel Cohen
arXiv Machine Learning
Sep 22

Learning Physics from an Imperfect Ancestor

arXiv:2609.24947v1 Announce Type: new Abstract: Neural operators evaluate parametric partial differential equations cheaply but degrade sharply outside their training distribution. Physics-informed n...

By S. Mohammad Mousavi, Teeratorn Kadeethum, Nikolaos Bouklas, Somdatta Goswami
arXiv Machine Learning
Aug 27

StablePDENet: Enhancing Neural Operator Stability through Physics-Informed Residual-Sensitivity Regularization

The paper introduces StablePDENet, a physics-informed adversarial training framework that regularizes the residual sensitivity of neural operators to improve stability against input perturbations. The method formulates operator learning as a min–max optimization, where a physics-based projected‑gradient adversary generates perturbations and the outer objective combines the attacked physics loss with a normalized residual‑sensitivity penalty. Experiments on benchmark problems show that StablePDENet outperforms PI‑DeepONet and its adversarial variant in accuracy under adversarial attacks while maintaining competitive performance on clean data, and it also enhances generalization and highlights the distinction between model sensitivity and intrinsic operator ill‑conditioning.

By Chutian Huang, Chang Ma, Kaibo Wang, Yang Xiang
arXiv Machine Learning
Sep 29

Deep-Learning Solvers and Surrogates for Infinity and p-Laplace Problems

The paper explores neural network solvers for infinity and p‑Laplace problems, employing Physics‑Informed Neural Networks (PINNs) and Deep Operator Networks (DeepONets). It addresses computational challenges for large p values (2 to 1000) across 2D and 3D domains, showing advantages over traditional mesh‑based solvers, especially in three dimensions. The authors provide conditional convergence results for PINNs, a universal approximation theorem for DeepONet on the parametric p‑Poisson problem, and validate their methods with numerical experiments comparing performance to conventional approaches.

By Tak Shing Au Yeung, Ka Chun Cheung, Hannah Potgieter, Steven J. Ruuth, Simon See