arXiv Statistics ML

Poincar\'e's Inequality on Sliding-Window Occupation Count Kernels and the Optimal Normalized Spectral-Gap Constant

The paper studies the spectral gap of a projected count kernel τP_n derived from an irreducible reversible Markov kernel P on an m‑state space. It establishes bounds on the optimal normalized comparison constant c_m^* = inf nGap( τP_n)/Gap(P), showing 1/(1080m) ≤ c_m^* ≤ q_{m-2} where q_{r+1}=q_r(1-q_r) and q_0=1/4. The authors prove that q_{m-2}=(m+log m+O(1))^{-1}, implying c_m^*=Θ(m^{-1}) and that the reciprocal optimal comparison cost C_m^{opt} grows linearly with m; exact values are given for the two‑state case.

arXiv Machine Learning
Aug 18

Spectral Gaps of Hit-and-Run and Coordinate Hit-and-Run

arXiv:2608. 16878v1 Announce Type: cross Abstract: For any convex body $\mathcal{K}\subset\mathbb{R}^{n}$ containing a unit ball, the spectral gap of Hit-and-Run is $\Omega(1/(n^2 C_{\mathsf{PI}}))$, where $C_{\mathsf{PI}}$ is the Poincar\'e constant of the uniform distribution $\pi$ over $\mathcal{K}$.

By Yunbum Kook, Santosh S. Vempala
arXiv Statistics ML
Sep 7

Simultaneous Pointwise Majorization for Mixed Tail Processes with Applications in Gaussian Chaos and Ergodic Diffusions

The paper introduces a new simultaneous pointwise majorization framework for Banach‑valued stochastic processes that possess finite‑metric mixed‑tail increments. By assuming an anchored process satisfies a tail bound involving multiple pseudo‑metrics and orders, the authors derive a high‑probability envelope that holds uniformly over the index set, with terms expressed through integrals of log‑covering numbers and distance functions. This result generalizes single‑metric sub‑Weibull bounds and, in the Gaussian case, improves existing pointwise upper bounds by removing extraneous logarithmic factors.

By Haichen Hu, David Simchi-Levi
arXiv Machine Learning
Jul 28

A Resolution of the SS--RS--GD Inequalities

arXiv:2607. 22620v1 Announce Type: cross Abstract: Yun, Sra, and Jadbabaie (COLT 2021, open question) conjectured the SS--RS--GD inequalities: for well-conditioned symmetric matrices $A_1,\dots,A_n$, the operators $W_{ss}$, $W_{rs}$, and $W_{gd}$ that encode the expected iterate of single-shuffle SGD, random-reshuffle SGD, and gradient descent on a quadratic finite sum should satisfy \[ \|W_{ss}\|\le \| W_{rs}\|\le \|W_{gd}\|.

By Binghui Peng
arXiv Machine Learning
Jun 15

Nonlinear Two-Time-Scale Stochastic Approximation: A Sharp Phase Transition and How to Beat It

arXiv:2606. 14488v1 Announce Type: cross Abstract: Recent finite-time analyses of nonlinear two-time-scale stochastic approximation show that under contractive assumptions the slow iterate $Y_k$ with stepsizes $\beta_k=\Theta(k^{-1})$ and $\alpha_k=\Theta(k^{-a})$, $a\in(1/2,1)$, generally satisfies a mean-square rate of order $k^{-a}$; decoupled $k^{-1}$ rates require strong local linearity.

By Dhruv Sarkar, Vaneet Aggarwal