arXiv Machine Learning By Yulun Wu, Miguel Aguiar, Karl H. Johansson, Matthieu Barreau

Iterative Training of Physics-Informed Neural Networks with Fourier-enhanced Features

Read the original on arXiv Machine Learning →

arXiv:2510. 19399v2 Announce Type: replace Abstract: Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs).

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Aug 6

Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features

Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions, as well as strongly nonlinear problems. Two factors underlie this difficulty: spectral bias, the tendency of neural networks to underfit high-frequency features; and representation-coefficient coupling, the entanglement of representation learning and coefficient fitting within a single nonconvex optimization objective.

arXiv AI
Sep 17

Enhancing Physics-Informed Neural Networks with Domain-aware Fourier Features: Towards Improved Performance and Interpretable Results

The paper proposes Domain-aware Fourier Features (DaFFs) for Physics-Informed Neural Networks (PINNs), embedding domain-specific geometry and boundary conditions into the positional encoding. DaFFs eliminate the need for explicit boundary loss terms, simplify optimization, and reduce training cost, leading to orders-of-magnitude lower errors and faster convergence compared to vanilla PINNs and RFF-based PINNs. An LRP-based explainability framework further shows that DaFFs produce more physically consistent relevance attributions, improving interpretability.

By Alberto Mi\~no Calero, Luis Salamanca, Konstantinos E. Tatsis
arXiv Machine Learning
Aug 27

When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study

The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.

By Shubham Rai