arXiv Machine Learning By Dongmin Lee, William Lu, Anuran Makur

On the Oracle Complexity of Interpolation-Based Gradient Descent

Read the original on arXiv Machine Learning →

arXiv:2606. 19878v1 Announce Type: new Abstract: Recent work on first-order optimizers for empirical risk minimization (ERM) has suggested that smoothness of ERM loss functions in the training data, rather than in the optimization parameters, can be leveraged to improve the oracle complexity of gradient descent (GD) methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Statistics ML
4d ago

The double descent and Runge phenomena in overparametrized polynomial interpolation

The paper investigates overparameterized polynomial interpolation across three polynomial bases—Monomial, Chebyshev, and Legendre—using coefficients minimal in the σ^2-norm (and σ^1-norm for the monomial basis). It focuses on equidistant and Chebyshev data points, though many findings hold regardless of sampling specifics. The study draws parallels between the classical Runge phenomenon and the modern double descent phenomenon in machine learning.

By Jason Wein, Stephan Wojtowytsch