arXiv Machine Learning By Shijun Zhang, Hongkai Zhao, Yimin Zhong, Haomin Zhou

Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential

Read the original on arXiv Machine Learning →

arXiv:2502. 18959v4 Announce Type: replace Abstract: The architecture of a neural network and the choice of its activation function are both fundamental to its performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jun 26

Theory of the Frequency Principle for General Deep Neural Networks

arXiv:1906. 09235v3 Announce Type: replace Abstract: Along with fruitful applications of Deep Neural Networks (DNNs) to realistic problems, recently, some empirical studies of DNNs reported a universal phenomenon of Frequency Principle (F-Principle): a DNN tends to learn a target function from low to high frequencies during the training.

By Tao Luo, Zheng Ma, Zhi-Qin John Xu, Yaoyu Zhang