The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The paper establishes global convergence guarantees for third‑order Langevin dynamics applied to non‑convex optimization via simulated annealing with fixed friction and decreasing noise. It shows that, under dissipativity, regularity, and low‑temperature functional‑inequality assumptions, a logarithmic cooling schedule drives objective values to the global minimum with a barrier‑controlled kinetic rate, and that polynomially decreasing step sizes preserve this rate for both exact‑force‑integral and midpoint three‑stage discretizations. Numerical experiments on a double‑well problem and high‑dimensional neural‑network objectives demonstrate that third‑order Langevin schemes outperform overdamped Langevin dynamics and, in some cases, the one‑gradient UBU integrator in terms of terminal‑success point estimates and post‑quench test accuracy.
The paper presents a non‑asymptotic analysis of Markov chain Monte Carlo (MCMC) algorithms that learn and apply a preconditioner based on either the target covariance or the expected Hessian of the target potential. It compares the finite‑time computational costs of these preconditioned schemes with unpreconditioned counterparts, providing guarantees for algorithms such as the Unadjusted Langevin Algorithm (ULA) and the proximal sampler. The analysis relies on a contraction assumption in the Wasserstein‑2 distance to formalize approximate independence and bridge modern MCMC theory with classical effective sample size heuristics.
arXiv:2610.16248v1 Announce Type: cross Abstract: We study sampling from $\pi(x)\propto\mathrm{e}^{-V(x)}$ on $\mathbb{R}^d$, where $V$ is $\alpha$-strongly convex and $\beta$-smooth with condition n...
arXiv:2608.25279v1 Announce Type: cross Abstract: The OBABO and BAOAB schemes and the other standard Strang splittings of kinetic (underdamped) Langevin dynamics are widely used Markov chain Monte Ca...
The paper introduces Hessian-free high-resolution (HFHR) dynamics, an extension of underdamped Langevin dynamics that incorporates reversible position diffusion for sampling in machine learning. It provides an explicit quantitative contraction rate under a position Poincaré inequality, weighted Hessian and Laplacian bounds, and a compact Sobolev embedding, even when the potential is non‑convex. For the HFHR Monte Carlo algorithm, a path‑space Girsanov argument yields a non‑asymptotic convergence bound and an explicit iteration complexity in total variation distance, improving on previous HFHR results and demonstrating benefits of a positive diffusion parameter through numerical experiments.
arXiv:2606. 26164v1 Announce Type: new Abstract: Finding all modes of a multimodal black-box function is a fundamental challenge in optimization, Bayesian inference, and scientific computing.