arXiv AI
Jun 29
Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs
arXiv:2606. 28122v1 Announce Type: cross Abstract: Neural operators provide deep neural networks for learning mappings between function spaces.
SirenFNO: Efficient and Full Frequency Learning of Fourier Neural Operators
arXiv:2606. 11518v1 Announce Type: cross Abstract: Fourier neural operators (FNOs) are effective and efficient surrogates for approximating solutions of PDEs and generalize across discretizations.
Related stories
arXiv Machine Learning
Jun 9
Fourier Neural Operators with rank-1 lattice points and hyperbolic cross
arXiv:2606. 08871v1 Announce Type: cross Abstract: The \emph{Fourier neural operator} (FNO) is a neural network architecture that learns mappings between function spaces.
arXiv Machine Learning
Jun 16
Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs
arXiv:2605. 31027v2 Announce Type: replace Abstract: We propose a novel neural network architecture, termed Multi-Scale Separable Fourier Neural Networks (MS-SFNN), for the accurate and efficient solution of linear and nonlinear high-frequency partial differential equations (PDEs).
arXiv AI
Aug 18
A Novel Fourier Feature Network for Solving Partial Differential Equations
arXiv:2608. 14733v1 Announce Type: cross Abstract: Building on the foundation of single-hidden-layer neural networks, Fourier Feature Networks (FENs) are proposed, which incorporate Fourier features using $\cos$, $\sin$, or a combination of both.
arXiv Machine Learning
Sep 10
Learning Metamaterial Eigenmodes with Wavelet-Encoded Fourier Neural Operators
The paper introduces a method that combines Fourier Neural Operators with wavelet-based encodings to learn and predict multiple eigenmodes of the elastic wave equation in metamaterials. By encoding PDE inputs with wavelets, the model can deterministically select eigenmodes for both continuous and binary geometries, and it explains how prediction accuracy depends on geometric discontinuities. The surrogate model achieves a three‑order‑of‑magnitude speedup over finite element analysis while maintaining high fidelity, offering a powerful tool for accelerating metamaterial design.
arXiv Machine Learning
Jun 30
Spectral Gating via Damped Oscillations for Adaptive Implicit Neural Representations
arXiv:2606. 23129v2 Announce Type: replace-cross Abstract: Implicit Neural Representations (INRs) have been proven successful in encoding continuous signals through coordinate-based networks, yet facing a spectral dilemma: periodic activations capture fine details but act as all-pass filters that memorise noise, while spatially compact activations regularise effectively but suffer from low-frequency bias.
arXiv Machine Learning
Aug 27
When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study
The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.
arXiv Machine Learning
4d ago
Learning Spectrally Optimised Mesh-Free Discretisations
The paper introduces Spectrally Optimised Neural Discretisations (SpeND), a mesh‑free framework that learns discretisation weights from local stencil geometry on unstructured point clouds. By embedding discrete moment conditions into the network architecture, SpeND guarantees polynomial consistency and allows the weights to be optimised for spectral accuracy over a chosen wavenumber band, using an unsupervised Fourier‑mode loss. The resulting operators are PDE‑agnostic, perform well on Poisson, Burgers, and Navier–Stokes equations, and can reduce wall‑clock time by 3–20× compared to existing mesh‑free methods at the same accuracy.
arXiv Machine Learning
Jun 18
Starter-Iterator Neural Operator: A Unified Architecture for High-Fidelity Forward and Inverse PDE Problems
arXiv:2606. 18305v1 Announce Type: cross Abstract: Operator learning is an emerging interdisciplinary field that integrates machine learning with scientific computing.
arXiv Machine Learning
Jun 30
Spectral Embedding via Chebyshev Bases for Robust DeepONet Approximation
arXiv:2512. 09165v2 Announce Type: replace Abstract: Deep Operator Networks (DeepONets) have emerged as a powerful framework for data-driven operator learning, providing flexible surrogates for nonlinear mappings arising in partial differential equations (PDEs).
arXiv Machine Learning
Jun 16
RepNet: Tackling spectral bias in deep neural networks via parameter reparameterization
arXiv:2606. 16575v1 Announce Type: new Abstract: Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors.
arXiv AI
Sep 1
Frequency Selective Neural Networks as a Foundation Architecture for Time Series Learning
The paper introduces the Frequency Selective Neural Network (FSNN), a new foundation architecture for time‑series learning that embeds advanced signal‑processing mathematics into its neural topology. By using a fully differentiable Wiener‑like filter bank optimized with complex‑domain backpropagation, FSNN autonomously discovers and isolates the precise physical modes of a given task, thereby avoiding the spectral entanglement that plagues CNNs, RNNs, and Transformers. Extensive evaluations show that FSNN achieves state‑of‑the‑art predictive performance, attaining 77.0 % average accuracy on the 10 multivariate UEA datasets and leading all major metrics on the imbalanced PTB‑XL ECG benchmark, while converging directly on physically meaningful frequency bands such as the cardiac QRS complex.