arXiv:2606. 16575v2 Announce Type: replace Abstract: Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors.
By Yong Wang, Tao Zhou, Xuhui Meng
arXiv:2605. 31027v2 Announce Type: replace Abstract: We propose a novel neural network architecture, termed Multi-Scale Separable Fourier Neural Networks (MS-SFNN), for the accurate and efficient solution of linear and nonlinear high-frequency partial differential equations (PDEs).
By Qihong Yang, Qiaolin He
The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.
By Shubham Rai
The paper introduces the Frequency Selective Neural Network (FSNN), a new foundation architecture for time‑series learning that embeds advanced signal‑processing mathematics into its neural topology. By using a fully differentiable Wiener‑like filter bank optimized with complex‑domain backpropagation, FSNN autonomously discovers and isolates the precise physical modes of a given task, thereby avoiding the spectral entanglement that plagues CNNs, RNNs, and Transformers. Extensive evaluations show that FSNN achieves state‑of‑the‑art predictive performance, attaining 77.0 % average accuracy on the 10 multivariate UEA datasets and leading all major metrics on the imbalanced PTB‑XL ECG benchmark, while converging directly on physically meaningful frequency bands such as the cardiac QRS complex.
By Hui Huang, Ye Sun, Shiyan Hu
arXiv:2309. 07401v2 Announce Type: replace-cross Abstract: Deep neural networks (DNNs) show great promise for solving partial differential equations (PDEs), but their deep architectures introduce complex, large-scale, non-convex optimization challenges.
By Yuesheng Xu, Taishan Zeng
arXiv:2505. 13196v3 Announce Type: replace-cross Abstract: We introduce Velocity-Regularized Adam (VRAdam), a physics-inspired optimizer for training deep neural networks that draws on ideas from quartic terms for kinetic energy with its stabilizing effects on various system dynamics.
By Pranav Vaidhyanathan, Lucas Schorling, Natalia Ares, Maike Osborne