arXiv AI

Enhancing Physics-Informed Neural Networks with Domain-aware Fourier Features: Towards Improved Performance and Interpretable Results

The paper proposes Domain-aware Fourier Features (DaFFs) for Physics-Informed Neural Networks (PINNs), embedding domain-specific geometry and boundary conditions into the positional encoding. DaFFs eliminate the need for explicit boundary loss terms, simplify optimization, and reduce training cost, leading to orders-of-magnitude lower errors and faster convergence compared to vanilla PINNs and RFF-based PINNs. An LRP-based explainability framework further shows that DaFFs produce more physically consistent relevance attributions, improving interpretability.

arXiv Machine Learning
Oct 8

Fourier Feature Pyramids for Physics-Informed Neural Networks

The paper introduces beignet, a neural field architecture that replaces the random Fourier feature embedding in physics-informed neural networks with a trainable multi‑resolution Fourier feature pyramid. By using Fourier interpolation and spectral derivatives, beignet efficiently computes spatial derivatives and scales accuracy through the feature pyramid rather than the neural network size. Experiments show that beignet achieves more accurate PDE solutions with fewer parameters than existing PINN methods and can reach machine‑precision residuals on the inviscid Burgers blowup problem using the Adam optimizer.

By Brandon Zhao, Yixuan Wang, Jonathan T. Barron, Katherine L. Bouman, Dor Verbin, Pratul P. Srinivasan
arXiv Machine Learning
Jun 5

On the training of physics-informed neural operators for solving parametric partial differential equations

arXiv:2606. 06164v1 Announce Type: new Abstract: Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data.

By Nanxi Chen, Chuanjie Cui, Airong Chen, Sifan Wang, Rujin Ma
Hugging Face Trending Papers
Jun 4

On the training of physics-informed neural operators for solving parametric partial differential equations

Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data. By incorporating physical constraints into the training objective, PINOs combine the cross-instance generalization of neural operators with the data efficiency of physics-informed learning.

arXiv Machine Learning
Oct 5

Operator-informed initialization for Fourier features physics-informed neural networks

The paper introduces an operator-informed initialization for Fourier Feature Physics-Informed Neural Networks (PINNs) to mitigate spectral bias, where certain frequencies converge slower. By analyzing training dynamics in the Neural Tangent Kernel regime, the authors derive an evolution equation linking convergence rates to the product of the differential operator’s symbol and the spectral density of initialization weights. They propose tailoring the initial weight distribution to the specific PDE, which balances convergence across frequencies and improves prediction accuracy without extra training cost, as confirmed by experiments on linear and nonlinear PDEs.

By Juan Molina, Paris Perdikaris, Mircea Petrache, Mat\'ias Courdurier, Francisco Sahli Costabal