arXiv AI

Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs

arXiv:2606. 28122v1 Announce Type: cross Abstract: Neural operators provide deep neural networks for learning mappings between function spaces.

Hugging Face Trending Papers
Aug 6

Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features

Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions, as well as strongly nonlinear problems. Two factors underlie this difficulty: spectral bias, the tendency of neural networks to underfit high-frequency features; and representation-coefficient coupling, the entanglement of representation learning and coefficient fitting within a single nonconvex optimization objective.

arXiv Machine Learning
Aug 31

Euclidean Fourier Neural Operators

Euclidean Fourier Neural Operators (EFNOs) extend Fourier neural operators by making the spectral kernel a continuous function of physical wavevectors, thereby removing dependence on specific periodic domain shapes and sizes. This domain‑independent formulation allows EFNOs to learn operators that generalize across different grid resolutions and domain geometries. Experiments on a heat equation and a materials‑science task demonstrate that EFNOs can successfully transfer learned mappings to unseen grid sizes and crystal structures.

By Nathanael Bosch, Niklas Frederik Schmitz, Michael F. Herbst
arXiv Machine Learning
Aug 27

When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study

The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.

By Shubham Rai
arXiv Machine Learning
Aug 20

Multi-stage neural operator learning with application for convolutions

The paper introduces two multi-stage neural operator learning frameworks—Deep Collocation Neural Operator (DCNO) and Deep Galerkin Neural Operator (DGNO)—for efficiently computing convolution integrals. DCNO is a supervised method that iteratively refines operator approximations by learning residuals from data pairs, while DGNO is an unsupervised approach that uses the weak form of a PDE residual when the operator can be represented by a PDE. Both frameworks build basis operators across multiple training stages, yielding markedly higher accuracy than one-shot learning and achieving near machine‑precision results for convolution problems, with significant efficiency gains for repeated queries or parametric variations.

By Zhiping Mao, Zhenye Wen, Yong Zhang, Xiaofei Zhao