arXiv Machine Learning

Stable Density Ridges: Consistency and Convergence of Subspace Constrained Mean Shift

arXiv:2608. 05112v1 Announce Type: cross Abstract: The Subspace Constrained Mean Shift (SCMS) algorithm is a popular nonparametric method for extracting density ridges, which serve as a low-dimensional representation of high-dimensional data.

arXiv Machine Learning
Jun 30

Non-Euclidean Gradient Descent Operates at the Edge of Stability

arXiv:2603. 05002v3 Announce Type: replace Abstract: The Edge of Stability (EoS) is a phenomenon where the sharpness (largest eigenvalue) of the Hessian approaches and then hovers near the stability threshold $2/\eta$ during gradient descent (GD) with step size $\eta$.

By Rustem Islamov, Michael Crawshaw, Jeremy Cohen, Robert Gower
arXiv Machine Learning
Jun 8

Constrained Extreme Gradient Boosting for Adapting Reduced-Order Models

arXiv:2605. 04130v2 Announce Type: replace Abstract: High-fidelity simulations, such as computational fluid dynamics and finite element analysis, are essential for modeling complex engineering systems but are often prohibitively expensive for tasks including parametric studies, optimization, and real-time control.

By Melika Baghi, Xiao Liu, Kamran Paynabar
Hugging Face Trending Papers
Jul 7

On the Condition Number Upper Bound of the L-BFGS Inverse Hessian Approximation Matrix with a Two-Sided Geometric Envelope Safeguarding Mechanism

The limited-memory BFGS (L-BFGS) algorithm is a cornerstone of large-scale optimization due to its linear memory and computational costs. However, in ill-conditioned or non-convex landscapes, the implicit inverse Hessian approximation can suffer from an exploding condition number, leading to numerical instability and degraded convergence.