Hugging Face Trending Papers

Sharp Root Anti-Concentration via Projective Incidence and Ordered Root Laws

This paper answers the one-dimensional local root anti-concentration questions posed by Balcan, Pegden, and Sharma in the context of online optimization of piecewise-Lipschitz functions. For a homogeneous feature curve and coefficients whose density relative to the uniform law on a symmetric convex body $K$ is bounded by $A$, we show that the worst-case interval-hitting constant equals $A$ times a section-averaged projective incidence speed.

arXiv Machine Learning
Sep 3

Smoothed Analysis for Learning Concepts with Low Intrinsic Dimension

arXiv:2407. 00966v3 Announce Type: replace Abstract: In traditional models of supervised learning, the goal of a learner-- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$-- is to output a hypothesis that is competitive (to within $\epsilon$) of the best fitting concept from some class.

By Gautam Chandrasekaran, Adam Klivans, Vasilis Kontonis, Raghu Meka, Konstantinos Stavropoulos
arXiv Machine Learning
1d ago

Sharp Oracle-Regret Tradeoffs for Projection-Free Online Convex Optimization

The paper studies online convex optimization when the learner can only query an exact linear optimization oracle. It establishes a dimension‑free minimax expected regret bound of θ(GD max{√T, T/(1+min{Q,BT})^{1/4}}) for convex G‑Lipschitz losses, where Q is the total oracle budget and B the per‑round limit. The authors provide matching lower and upper bounds, showing how strict per‑round or total‑budget constraints affect the achievable regret, and extend the analysis to smooth losses with curvature‑dependent bounds.

By Vaneet Aggarwal
arXiv Machine Learning
Sep 10

Feature Priming in Online Linear Regression: Sparse-Regret Lower Bounds and Tight Coordinatewise Rates

The paper investigates online linear regression with sparse comparators, focusing on feature priming techniques that reweight features using past data. It establishes sparse‑regret lower bounds that invalidate sparse‑logarithmic guarantees for univariate, Pearson, and multivariate priming rules under a past‑only Moore–Penrose protocol, showing ≥Ω(min{T,√d}) clipped regret for unit‑power rules and linear regret for powered rules in high dimensions. The authors also provide tight rank upper bounds for certain priming schemes and present algebraic constructions yielding Ω(min{T,d^{1/4}}) regret for unit‑power multivariate priming, while noting that the exact multivariate frontier remains open.

By Huibo Xu, Shi Fu, Qixin Zhang, Dacheng Tao
arXiv Machine Learning
Aug 24

Query Efficient Structured Matrix Learning

arXiv:2507.19290v2 Announce Type: replace-cross Abstract: We study the problem of learning a structured approximation (low-rank, sparse, banded, etc.) to an unknown matrix $A$ given access to matrix-...

By Noah Amsel, Pratyush Avi, Tyler Chen, Feyza Duman Keles, Chinmay Hegde, Cameron Musco, Christopher Musco, David Persson