The paper introduces CAFE+FNO, a Fourier Neural Operator variant that enhances kernel generation by combining Fourier–Chebyshev features through parallel affine branches and a Hadamard product. This method produces frequency interactions explicitly, allowing a kernel MLP to map each normalized spectral coordinate to a complex channel‑mixing matrix while keeping the number of trainable parameters independent of the number of modes. Experiments on five PDE benchmarks and ablation studies demonstrate the effectiveness of the proposed basis configuration, multiplicative composition, and bandwidth learnability.
arXiv:2606. 11518v1 Announce Type: cross Abstract: Fourier neural operators (FNOs) are effective and efficient surrogates for approximating solutions of PDEs and generalize across discretizations.
arXiv:2606. 28122v1 Announce Type: cross Abstract: Neural operators provide deep neural networks for learning mappings between function spaces.
arXiv:2605. 31027v2 Announce Type: replace Abstract: We propose a novel neural network architecture, termed Multi-Scale Separable Fourier Neural Networks (MS-SFNN), for the accurate and efficient solution of linear and nonlinear high-frequency partial differential equations (PDEs).
The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.
The paper introduces beignet, a neural field architecture that replaces the random Fourier feature embedding in physics-informed neural networks with a trainable multi‑resolution Fourier feature pyramid. By using Fourier interpolation and spectral derivatives, beignet efficiently computes spatial derivatives and scales accuracy through the feature pyramid rather than the neural network size. Experiments show that beignet achieves more accurate PDE solutions with fewer parameters than existing PINN methods and can reach machine‑precision residuals on the inviscid Burgers blowup problem using the Adam optimizer.
arXiv:2607. 02199v1 Announce Type: cross Abstract: Mutual information (MI)-inspired feature learning techniques are capable of generating low-dimensional embeddings that retain nonlinear dependence structures, but direct estimations of MI suffer from noisy probability distribution estimates in the low-data regime.
arXiv:2606. 08871v1 Announce Type: cross Abstract: The \emph{Fourier neural operator} (FNO) is a neural network architecture that learns mappings between function spaces.
arXiv:2609.22139v1 Announce Type: cross Abstract: Automatic modulation classification (AMC) of received radio signals is prudent for further signal processing tasks such as communication monitoring,...
arXiv:2608. 14733v1 Announce Type: cross Abstract: Building on the foundation of single-hidden-layer neural networks, Fourier Feature Networks (FENs) are proposed, which incorporate Fourier features using $\cos$, $\sin$, or a combination of both.
Euclidean Fourier Neural Operators (EFNOs) extend Fourier neural operators by making the spectral kernel a continuous function of physical wavevectors, thereby removing dependence on specific periodic domain shapes and sizes. This domain‑independent formulation allows EFNOs to learn operators that generalize across different grid resolutions and domain geometries. Experiments on a heat equation and a materials‑science task demonstrate that EFNOs can successfully transfer learned mappings to unseen grid sizes and crystal structures.
arXiv:2510. 19399v2 Announce Type: replace Abstract: Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs).
The paper introduces the Frequency Selective Neural Network (FSNN), a new foundation architecture for time‑series learning that embeds advanced signal‑processing mathematics into its neural topology. By using a fully differentiable Wiener‑like filter bank optimized with complex‑domain backpropagation, FSNN autonomously discovers and isolates the precise physical modes of a given task, thereby avoiding the spectral entanglement that plagues CNNs, RNNs, and Transformers. Extensive evaluations show that FSNN achieves state‑of‑the‑art predictive performance, attaining 77.0 % average accuracy on the 10 multivariate UEA datasets and leading all major metrics on the imbalanced PTB‑XL ECG benchmark, while converging directly on physically meaningful frequency bands such as the cardiac QRS complex.