arXiv Machine Learning

Beyond PINNs: A Unified Gauss--Newton and Petrov--Galerkin Framework for Neural and Hybrid PDE Solvers

The paper proposes a unified framework that combines physics‑informed neural networks (PINNs) and finite element methods (FEM) by discretizing functional Gauss–Newton problems using finite families of linear measurements. By interpreting these measurements as test functions, the resulting Gauss–Newton system becomes a Petrov–Galerkin discretization of the linearized functional problem, thereby encompassing pointwise collocation and natural‑gradient approaches as special cases. The framework is specialized to elliptic partial differential equations, yielding weak residual formulations and a hybrid finite‑element–neural architecture that operates on complementary approximation spaces, with numerical experiments confirming its effectiveness.

arXiv Machine Learning
Sep 17

DPG loss functions for learning parameter-to-solution maps by neural networks

The paper introduces residual-based loss functions derived from Discontinuous Petrov Galerkin (DPG) discretizations for training neural networks to learn parameter-to-solution maps of PDEs. It focuses on rigorous accuracy certification and demonstrates the approach on an elliptic PDE, showing that DPG-based losses outperform simple least-squares losses, especially for high-contrast diffusion problems. The concepts are applicable to any problem with a stable DPG formulation.

By Pablo Cort\'es Castillo, Wolfgang Dahmen, Jay Gopalakrishnan
arXiv Machine Learning
Jul 23

PG-KINN: A Physics-Informed Petrov-Galerkin Kolmogorov-Arnold Network for Solving Forward and Inverse PDEs

arXiv:2607. 20378v1 Announce Type: new Abstract: Physics-informed learning of partial differential equations (PDEs) has been dominated by multilayer perceptrons (MLPs), whose spectral bias and dense parameterization limit both accuracy and interpretability.

By Amirhossein Sadr, Nima Soltani, Vahideh Moghtadaiee, Aida Pakniyat, Dara Rahmati, Saeid Gorgin
arXiv Machine Learning
Sep 2

Rigorous Error Certification for Neural PDE Solvers: From Empirical Residuals to Solution Guarantees

The paper presents a theoretical framework for certifying the accuracy of physics‑informed neural networks (PINNs) used to solve partial differential equations. It derives generalization bounds that link the residual loss minimized during training to the actual error in the solution space, showing that if the neural approximation stays within a compact subset, a vanishing residual guarantees convergence to the true solution. Deterministic and probabilistic convergence results are provided, offering explicit error guarantees based on residual, boundary, and initial condition errors.

By Amartya Mukherjee, Maxwell Fitzsimmons, David C. Del Rey Fern\'andez, Jun Liu
arXiv Machine Learning
Jun 11

Adjoint Method versus Physics-Informed Neural Networks in PDE-Constrained Inverse Problems

arXiv:2606. 12337v1 Announce Type: cross Abstract: Inverse problems governed by partial differential equations (PDEs) are central to computational mechanics and are commonly solved by adjoint-based optimization, while physics-informed neural networks (PINNs) have emerged as a flexible alternative.

By Zhen Zhang, Alessandro Alla, George Em Karniadakis
arXiv Machine Learning
Jul 28

Global Convergence of DGM and PINN Algorithms for Solving Nonlinear PDEs

arXiv:2607. 24726v1 Announce Type: new Abstract: The Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) have become widely-used methods for solving partial differential equations (PDEs) in the rapidly growing field of scientific machine learning.

By Justin Sirignano, Konstantinos Spiliopoulos, Samuel Cohen
arXiv Machine Learning
Jun 17

A Convex Quasilinearization Method for Solving Nonlinear PDEs with Physics-Informed Neural Networks

arXiv:2606. 18175v1 Announce Type: cross Abstract: We present a numerical method for the forward solution of nonlinear partial differential equations (PDEs) in which Bellman-Kalaba quasilinearization reduces the nonlinear problem to a sequence of linear subproblems, each discretized by collocation onto a trial space that is linear in its parameters and solved by a single direct linear least-squares QR factorization.

By Gbenga T. Awojinrin, Abdul-Akeem Olawoyin, Rami M. Younis
arXiv Machine Learning
Jun 26

Random test functions, $H^{-1}$ norm equivalence, and stochastic variational physics-informed neural networks

arXiv:2605. 03542v2 Announce Type: replace-cross Abstract: The dual norm characterisation of weak solutions of second-order linear elliptic partial differential equations is mathematically natural but computationally intractable: evaluating the $H^{-1}$ norm of the residual requires a supremum over an infinite-dimensional test space.

By Diego Marcondes
Hugging Face Trending Papers
Aug 6

Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features

Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions, as well as strongly nonlinear problems. Two factors underlie this difficulty: spectral bias, the tendency of neural networks to underfit high-frequency features; and representation-coefficient coupling, the entanglement of representation learning and coefficient fitting within a single nonconvex optimization objective.