arXiv Machine Learning

Random test functions, $H^{-1}$ norm equivalence, and stochastic variational physics-informed neural networks

arXiv:2605. 03542v2 Announce Type: replace-cross Abstract: The dual norm characterisation of weak solutions of second-order linear elliptic partial differential equations is mathematically natural but computationally intractable: evaluating the $H^{-1}$ norm of the residual requires a supremum over an infinite-dimensional test space.

arXiv Machine Learning
Jul 22

Boundary-Adapted PINNs for Elliptic Dirichlet Problems: $H^2(\Omega)$ A Priori Error Bounds with Application to Mean Escape Time Computation

arXiv:2607. 19167v1 Announce Type: cross Abstract: Motivated by the numerical computation of the Mean Escape Time (MET) $\tau:\Omega\to\mathbb{R}$ of a stochastic process from a bounded domain $\Omega\subseteq\mathbb{R}^d$, we study elliptic Dirichlet boundary value problems (BVPs) using boundary-enforced Physics-Informed Neural Networks (PINNs), in which the Dirichlet condition is imposed exactly by multiplying the network output with a predefined distance-to-boundary approximation $\rho$.

By Nathanael Tepakbong, Jun Fan, Xiang Zhou, Ding-Xuan Zhou
arXiv Machine Learning
Jul 28

Global Convergence of DGM and PINN Algorithms for Solving Nonlinear PDEs

arXiv:2607. 24726v1 Announce Type: new Abstract: The Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) have become widely-used methods for solving partial differential equations (PDEs) in the rapidly growing field of scientific machine learning.

By Justin Sirignano, Konstantinos Spiliopoulos, Samuel Cohen
arXiv Machine Learning
Jun 25

A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients

arXiv:2606. 24999v1 Announce Type: new Abstract: High-dimensional partial differential equations (PDEs) with unknown coefficients arise widely in scientific machine learning, including continuous-time reinforcement learning, yet solving them efficiently in a data-driven way remains challenging.

By Yanwei Jia, Du Ouyang, Huy\^en Pham, Xun Yu Zhou
arXiv Machine Learning
4d ago

Exponential Convergence of Deep Operator Networks for Elliptic Partial Differential Equations

arXiv:2112. 08125v3 Announce Type: replace-cross Abstract: We construct and analyze approximation rates of deep operator networks (ONets) between infinite-dimensional spaces that emulate with an exponential rate of convergence the coefficient-to-solution map of elliptic second-order partial differential equations.

By Carlo Marcati, Christoph Schwab
arXiv Machine Learning
Jul 7

Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses

arXiv:2406. 14340v2 Announce Type: replace-cross Abstract: The standard stochastic gradient descent (SGD) optimization method, as well as adaptive methods such as the Adam optimizer fail to converge if the learning rates do not converge to zero (particularly, in the situation of constant learning rates).

By Steffen Dereich, Arnulf Jentzen, Adrian Riekert
arXiv Machine Learning
Sep 18

Beyond PINNs: A Unified Gauss--Newton and Petrov--Galerkin Framework for Neural and Hybrid PDE Solvers

The paper proposes a unified framework that combines physics‑informed neural networks (PINNs) and finite element methods (FEM) by discretizing functional Gauss–Newton problems using finite families of linear measurements. By interpreting these measurements as test functions, the resulting Gauss–Newton system becomes a Petrov–Galerkin discretization of the linearized functional problem, thereby encompassing pointwise collocation and natural‑gradient approaches as special cases. The framework is specialized to elliptic partial differential equations, yielding weak residual formulations and a hybrid finite‑element–neural architecture that operates on complementary approximation spaces, with numerical experiments confirming its effectiveness.

By Nilo Schwencke, Roland Maier
arXiv Machine Learning
Jun 2

Taming the Loss Landscape of PINNs with Noisy Feynman-Kac Supervision: Operator Preconditioning and Non-Asymptotic Error Bounds

arXiv:2606. 00643v1 Announce Type: cross Abstract: Physics-Informed Neural Networks (PINNs) often train slowly or fail to converge on challenging partial differential equations (PDEs), a behavior recently linked to severely ill-conditioned loss landscapes inherited from the underlying differential operator.

By Nathanael Tepakbong, Hanyu Hu, Chengyu Liu, Xiang Zhou
arXiv Statistics ML
Sep 14

PDE-constrained inverse problems at the $\sqrt{n}$ rate via debiased physics-informed neural networks

The paper introduces a two‑step debiased estimation method for PDE‑constrained inverse problems where the PDE solution is approximated by Physics‑Informed Neural Networks (PINNs). By combining neural‑network‑based nonparametric estimation with an influence‑function bias correction, the authors achieve a √{n}-consistent, asymptotically normal estimator without undersmoothing the neural network. The approach is extended to Bayesian inference, yielding a posterior that contracts at the √{n}-rate with asymptotic covariance matching the frequentist estimator, and the analysis also provides near‑minimax rates for estimating nonparametric regression functions and their derivatives in Sobolev spaces.

By Yves Atchade, Debarghya Mukherjee