arXiv Statistics ML
Sep 7

Simultaneous Pointwise Majorization for Mixed Tail Processes with Applications in Gaussian Chaos and Ergodic Diffusions

The paper introduces a new simultaneous pointwise majorization framework for Banach‑valued stochastic processes that possess finite‑metric mixed‑tail increments. By assuming an anchored process satisfies a tail bound involving multiple pseudo‑metrics and orders, the authors derive a high‑probability envelope that holds uniformly over the index set, with terms expressed through integrals of log‑covering numbers and distance functions. This result generalizes single‑metric sub‑Weibull bounds and, in the Gaussian case, improves existing pointwise upper bounds by removing extraneous logarithmic factors.

By Haichen Hu, David Simchi-Levi
arXiv Machine Learning
Jul 21

Scaling Limits of Constant-Stepsize SGD at Flat Minima

arXiv:2607. 16384v1 Announce Type: new Abstract: For stochastic gradient descent (SGD) with a constant stepsize $\alpha$, the invariant law of the iterates, centered at a minimizer, describes the behavior of the algorithm over long time horizons.

By Jingyi Zhang, Cheng Mao, Debankur Mukherjee
arXiv Machine Learning
4d ago

Poisson-Corrector Complexity Bounds for Moreau--Yosida Unadjusted Langevin Sampling

arXiv:2609. 12594v1 Announce Type: new Abstract: We study the classical Moreau--Yosida unadjusted Langevin algorithm (MYULA) for $\pi(\,\mathrm{d} x)\propto e^{-f(x)-g(x)}\,\mathrm{d} x$, where $f\in C^2(\mathbb{R}^d)$ is $m$-strongly convex with $L_f$-Lipschitz gradient and $g:\mathbb{R}^d\to\mathbb{R}$ is convex and globally $G$-Lipschitz.

By Yuchen Xin, Zhihua Zhang