The paper introduces penalized nonreversible Langevin algorithms for sampling from a target distribution constrained to a compact convex set. It combines a squared distance penalty with skew-symmetric perturbations that preserve the penalized Gibbs distribution, and provides nonasymptotic total variation and Wasserstein bounds under various smoothness and contraction assumptions. Numerical experiments demonstrate the methods on constrained Bayesian regression, classification, neural networks, and truncated sampling, highlighting acceleration in a stochastic quadratic model.
By Pervez Ali, Weihao Dong, Xiaoyu Wang
arXiv:2609.40193v1 Announce Type: new
Abstract: We establish near-linear accuracy bounds for the classical Moreau--Yosida unadjusted Langevin algorithm (MYULA). The target is $\pi\propto e^{-f-g}$, w...
By Yuchen Xin, Zhihua Zhang
arXiv:2610.16248v1 Announce Type: cross
Abstract: We study sampling from $\pi(x)\propto\mathrm{e}^{-V(x)}$ on $\mathbb{R}^d$, where $V$ is $\alpha$-strongly convex and $\beta$-smooth with condition n...
By Bo Yuan, Wei Guo, Yongxin Chen
The paper introduces Hessian-free high-resolution (HFHR) dynamics, an extension of underdamped Langevin dynamics that incorporates reversible position diffusion for sampling in machine learning. It provides an explicit quantitative contraction rate under a position Poincaré inequality, weighted Hessian and Laplacian bounds, and a compact Sobolev embedding, even when the potential is non‑convex. For the HFHR Monte Carlo algorithm, a path‑space Girsanov argument yields a non‑asymptotic convergence bound and an explicit iteration complexity in total variation distance, improving on previous HFHR results and demonstrating benefits of a positive diffusion parameter through numerical experiments.
By Wujun Lv, Xiaoyu Wang, Yingli Wang, Lingjiong Zhu
The paper establishes global convergence guarantees for third‑order Langevin dynamics applied to non‑convex optimization via simulated annealing with fixed friction and decreasing noise. It shows that, under dissipativity, regularity, and low‑temperature functional‑inequality assumptions, a logarithmic cooling schedule drives objective values to the global minimum with a barrier‑controlled kinetic rate, and that polynomially decreasing step sizes preserve this rate for both exact‑force‑integral and midpoint three‑stage discretizations. Numerical experiments on a double‑well problem and high‑dimensional neural‑network objectives demonstrate that third‑order Langevin schemes outperform overdamped Langevin dynamics and, in some cases, the one‑gradient UBU integrator in terms of terminal‑success point estimates and post‑quench test accuracy.
By Yingli Wang, Kelvin Shuangjian Zhang, Lingjiong Zhu
arXiv:2609.06196v1 Announce Type: cross
Abstract: We study the computational effort required for global optimization of a smooth, possibly nonconvex objective $\Gamma:\mathbb{R}^d\to\mathbb{R}$. An a...
By Ioannis Kontoyiannis, Sean Meyn
arXiv:2607. 15208v1 Announce Type: cross Abstract: Unadjusted samplers such as unadjusted Hamiltonian Monte Carlo and underdamped Langevin are well-known to be biased.
By Yifan Chen, Xiaoou Cheng, Jonathan Niles-Weed, Jonathan Weare
The paper introduces an iterative neural variational solver for the committor function in under‑damped Langevin dynamics. By splitting the infinitesimal generator into self‑adjoint and skew‑adjoint parts, each subproblem gains a variational form that can be efficiently solved with neural networks, resembling a generalized Concus‑Golub‑Widlund splitting. The method is validated on benchmark systems such as a double‑well potential, the Muller‑Brown potential, and alanine dipeptide, demonstrating practical accuracy and extensibility for studying rare transition events across different damping coefficients.
By Tiejun Li, Zhaoqi Liu, Xiang Zhou
The paper proves quantitative convergence to the target distribution and uniform‑in‑time propagation of chaos for Langevin‑regularized Stein variational gradient descent (SVGD). It shows that both the Stein interaction and the Langevin drift dissipate the same relative entropy, yielding exponential convergence under a log‑Sobolev inequality and providing finite‑particle entropy identities for empirical measures. Two finite‑time approaches—synchronous coupling and moving‑product entropy—are developed to give explicit Wasserstein, kernel Stein discrepancy, and total variation bounds, leading to polynomial uniform‑in‑time propagation of chaos rates.
By Sayan Banerjee, Dohyeon Kim
arXiv:2606. 24981v1 Announce Type: new Abstract: We study linear TD(0) under Markovian sampling, where data are generated along a single trajectory.
By Wei-Cheng Lee, Francesco Orabona
arXiv:2609. 17577v1 Announce Type: cross Abstract: We study Langevin diffusion and Langevin Monte Carlo (LMC) when the target distribution changes over time.
By Yuchen Xin, Jingxin Zhan, Zhihua Zhang
arXiv:2607. 13943v1 Announce Type: cross Abstract: Inspired by interior-point methods (IPM) for structured convex optimization, Kannan and Narayanan introduced the Dikin walk for sampling uniformly from polytopes in 2009.
By Yunbum Kook