arXiv Machine Learning
Singular Value Decomposition: A Geometric Rediscovery, Where Proofs Become Algorithms
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 3
Spectral Asymptotics of Neural Network Loss Landscapes: An Exact Decomposition of the Curvature Exponent
arXiv:2606. 02596v1 Announce Type: new Abstract: The curvature exponent $\alpha$ in $h_k \propto \sigma_k^\alpha$ -- governing how Hessian eigenvalues scale with gradient singular values -- varies systematically across layer types ($\alpha \approx 2$ for convolutions, $\approx 1$ for transformer attention, $< 1$ for MLP up-projections).
arXiv Computer Vision
Sep 1
Orthogonal Polynomial Approximation for Matrix Log Normalization in Global Covariance Pooling
arXiv:2608.19021v2 Announce Type: replace Abstract: Global Covariance Pooling (GCP) improves deep networks by capturing second-order feature statistics, and is especially effective for fine-grained r...
arXiv Machine Learning
Oct 5
Kernel Singular Value Decomposition with Extension to Multiple Data Sources
Kernel Singular Value Decomposition (KSVD) learns singular vectors for an asymmetric kernel matrix derived from two data sources. The paper extends KSVD to multiple data sources, introducing eKSVD, which jointly learns nonlinear feature mappings and captures maximal information across all sources while incorporating pair‑wise couplings. The authors derive a dual optimization framework, a covariance‑based approach, and demonstrate the effectiveness of eKSVD and neural‑network‑based feature mappings through numerical experiments.
arXiv Machine Learning
Jun 5
Efficient Mean Curvature Computation on High-Dimensional Data Manifolds
arXiv:2606. 06329v1 Announce Type: new Abstract: Estimating local mean curvature at each point of a high-dimensional dataset is a key ingredient of geometry-aware machine learning algorithms, such as the Mean Curvature Boundary Points (MCBP) method.
arXiv Machine Learning
Sep 4
Projected Riemannian Gradient Descent for the Bures-Wasserstein Barycenter: Dimension-Independent Linear Convergence at Unit Step Size
arXiv:2609. 03762v1 Announce Type: new Abstract: The computation of the Bures-Wasserstein (BW) barycenter of an ensemble of positive definite matrices arises throughout machine learning, optimal transport, and quantum information.
Hugging Face Trending Papers
Sep 3
Projected Riemannian Gradient Descent for the Bures-Wasserstein Barycenter: Dimension-Independent Linear Convergence at Unit Step Size
The paper introduces a Projected Riemannian Gradient Descent (RGD) algorithm for computing the Bures‑Wasserstein barycenter of positive definite matrices, achieving dimension‑independent linear convergence at unit step size. It resolves a previous dichotomy by showing that clipping eigenvalues to a fixed interval yields a closed‑form, non‑expansive projection in the BW metric, allowing the algorithm to match the empirical speed of unit‑step RGD while maintaining theoretical guarantees. The method also extends to the invariant matrix projection problem, providing a unified dimension‑independent analysis.