Hugging Face Trending Papers

Local Geometric Mixing via Dobrushin Contraction with Applications to Diffusion Path Monte Carlo and the Proximal Sampler

arXiv Machine Learning
Sep 24

Local Geometric Mixing via Dobrushin Contraction with Applications to Diffusion Path Monte Carlo and the Proximal Sampler

The paper introduces the concept of local geometric mixing, which focuses on geometric convergence to equilibrium in total variation over a finite number of transitions, thereby capturing rapid local equilibration even when global mixing is slow. It derives local geometric mixing bounds using Dobrushin contraction and applies these results to Diffusion Path Monte Carlo, a Markov chain Monte Carlo method that aligns with the Proximal Sampler. The analysis provides mixing guarantees for both the ideal method and its Metropolis-adjusted implementation, and extends recent spectral gap estimates into mixing time bounds.

By Stefan Oberd\"orster
arXiv Statistics ML
Sep 4

Markov Chain Monte Carlo with Diffusion Paths

The paper introduces a new Markov chain Monte Carlo method that samples from multimodal distributions by interpolating along the diffusion path of a noising diffusion process, preserving mode weights and improving mixing. It proposes a Metropolis-adjusted diffusion path (MAD-Path) sampler that corrects for bias from approximate score estimates and discretization errors, ensuring the target distribution remains invariant. Experiments on Bayesian posteriors demonstrate that MAD-Path outperforms tempering-based MCMC and unadjusted diffusion samplers in global exploration and accurate mode-weight estimation.

By Han Chen, Sifan Liu, Jun Yang
Hugging Face Trending Papers
Jul 8

Gradient-free Riemannian Langevin Sampler

We address the problem of efficiently sampling multimodal probability distributions, where standard Markov Chain Monte Carlo methods often suffer from poor mixing and mode trapping. To mitigate these issues, we propose Gradient-free Riemannian Langevin Sampler (GRiLS), a novel proposal that improves exploration without requiring gradient evaluations of the target density.

arXiv Machine Learning
Aug 31

On two proofs of $d^2$ mixing of weighted Dikin walks

The paper investigates the mixing time of weighted Dikin walks used for sampling from exponential distributions on polytopes and truncated positive-semidefinite cones. It presents a general total-variation mixing bound under conditions of strong self-concordance, ν-symmetry, and mixed-trace regularity, achieving an “~O(d^2)" bound for polytopes and “~O(d^4)" for truncated PSD cones. A second result introduces a fourth-order bootstrap condition that yields stronger χ^2-divergence guarantees and an improved “~O(d^2)" mixing bound for a scaled Lee–Sidford metric.

By Yuansi Chen, Yunbum Kook
arXiv Statistics ML
Oct 2

Muon meets Tamed Langevin: Momentum Preconditioning beyond Convex and gradient-Lipschitz Potentials

The paper introduces a new underdamped Langevin system for sampling Gibbs distributions on matrix spaces where the potential energy is neither convex nor globally gradient‑Lipschitz. By employing non‑quadratic kinetic energies, the authors achieve momentum preconditioning that smooths the momentum via a spectral taming of its gradient. They prove that this dynamics preserves the target Gibbs measure, converges exponentially fast in a weighted total variation distance, and that its Euler–Maruyama discretization remains stable with uniform moment bounds over time.

By Nikolaos Makras, Sotirios Sabanis
arXiv Machine Learning
Jul 7

Non-Asymptotic Error Bounds for SMC with Biased Proposals: Application to Conditional Diffusion Sampling

arXiv:2607. 04780v1 Announce Type: cross Abstract: Sequential Monte Carlo (SMC) methods are a natural tool for post-hoc conditioning of pretrained generative models, but in many applications the mutation kernels used by the particle system are biased approximations of an ideal Feynman--Kac flow.

By Stanislas Strasman (SU, LPSM), Gabriel Victorino Cardoso (LPSM), Sylvain Le Corff (LPSM), Vincent Lemaire (LPSM), Antonio Ocello