First order Langevin algorithms for constrained sampling in machine learning, such as projected Langevin Monte Carlo which are based on discretizations of reflected Langevin dynamics, require differen...
The paper introduces Hessian-free high-resolution (HFHR) dynamics, an extension of underdamped Langevin dynamics that incorporates reversible position diffusion for sampling in machine learning. It provides an explicit quantitative contraction rate under a position Poincaré inequality, weighted Hessian and Laplacian bounds, and a compact Sobolev embedding, even when the potential is non‑convex. For the HFHR Monte Carlo algorithm, a path‑space Girsanov argument yields a non‑asymptotic convergence bound and an explicit iteration complexity in total variation distance, improving on previous HFHR results and demonstrating benefits of a positive diffusion parameter through numerical experiments.
By Wujun Lv, Xiaoyu Wang, Yingli Wang, Lingjiong Zhu
The paper introduces non‑reversible anchored Langevin dynamics (NALD) and its reflected variant (NRALD) for sampling target distributions that may be non‑smooth and heavy‑tailed, both in Euclidean space and on constrained domains. By adding a circulation drift through a divergence‑free skew‑symmetric matrix field and a stream potential, the methods preserve the target distribution without needing density derivatives, admit a random‑time‑change representation, and can be applied with normal reflection on bounded domains. The authors demonstrate that breaking reversibility leads to faster convergence to the target distribution, as shown by finite‑time non‑asymptotic analysis, large‑deviations results, and asymptotic variance reduction, with numerical experiments confirming the algorithms’ efficiency.
By Pervez Ali, Xiaoyu Wang, Yingli Wang, Lingjiong Zhu
arXiv:2407.05790v4 Announce Type: replace-cross
Abstract: This paper introduces and analyses interacting underdamped Langevin algorithms, termed Kinetic Interacting Particle Langevin Monte Carlo (KIP...
By Paul Felix Valsecchi Oliva, O. Deniz Akyildiz
arXiv:2609. 17577v1 Announce Type: cross Abstract: We study Langevin diffusion and Langevin Monte Carlo (LMC) when the target distribution changes over time.
By Yuchen Xin, Jingxin Zhan, Zhihua Zhang
arXiv:2405. 15379v3 Announce Type: replace-cross Abstract: In this paper, we study the problem of sampling from log-concave distributions supported on convex and compact sets, with a particular focus on the randomized midpoint discretization of both overdamped and kinetic Langevin diffusions in constrained domains.
By Yifeng Yu, Shijie Zhang, Lu Yu