arXiv Machine Learning

Deeper or Wider: A Perspective from Optimal Generalization Error with Sobolev Loss

arXiv:2402. 00152v5 Announce Type: replace Abstract: Constructing the architecture of a neural network is a challenging pursuit for the machine learning community, and the dilemma of whether to go deeper or wider remains a persistent question.

arXiv Machine Learning
Jul 28

Global Convergence of DGM and PINN Algorithms for Solving Nonlinear PDEs

arXiv:2607. 24726v1 Announce Type: new Abstract: The Deep Galerkin Method (DGM) and Physics Informed Neural Networks (PINNs) have become widely-used methods for solving partial differential equations (PDEs) in the rapidly growing field of scientific machine learning.

By Justin Sirignano, Konstantinos Spiliopoulos, Samuel Cohen
arXiv Machine Learning
Sep 17

DPG loss functions for learning parameter-to-solution maps by neural networks

The paper introduces residual-based loss functions derived from Discontinuous Petrov Galerkin (DPG) discretizations for training neural networks to learn parameter-to-solution maps of PDEs. It focuses on rigorous accuracy certification and demonstrates the approach on an elliptic PDE, showing that DPG-based losses outperform simple least-squares losses, especially for high-contrast diffusion problems. The concepts are applicable to any problem with a stable DPG formulation.

By Pablo Cort\'es Castillo, Wolfgang Dahmen, Jay Gopalakrishnan