arXiv Machine Learning By Yong Wang, Tao Zhou, Xuhui Meng

RepNN: Tackling spectral bias in deep neural networks via parameter reparameterization

Read the original on arXiv Machine Learning →

arXiv:2606. 16575v2 Announce Type: replace Abstract: Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 15

Should All Noises Be Treated Equally: Impact of Input Noise Variability on Neural Network Robustness

The paper examines how varying input noise characteristics—type, scale, and complexity—affect neural network robustness in geophysical tasks such as first break picking and denoising. By training models on fixed noise settings and testing them on both seen and unseen noise scenarios, the study constructs a robustness matrix that reveals how larger noise scales improve generalization and how aligning noise type with task complexity and architecture maximizes performance. Training with compound noise mixtures further mitigates weaknesses of single-noise training, acting as an implicit regularizer that enhances robustness under out‑of‑distribution conditions.

By Salma Alsinan, Maksim Makarenko, Sixiu Liu, Ali Aldawood, Ibrahim Hoteit
arXiv Machine Learning
Aug 27

When Does Frequency Decomposition Benefit Physics-Informed Neural Networks? A Preliminary Ablation Study

The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.

By Shubham Rai