← Back to all news
arXiv Machine Learning By Pervez Ali, Xiaoyu Wang, Yingli Wang, Lingjiong Zhu

Accelerating Non-Smooth and Heavy-Tailed Sampling

Read the original on arXiv Machine Learning →

The paper introduces non‑reversible anchored Langevin dynamics (NALD) and its reflected variant (NRALD) for sampling target distributions that may be non‑smooth and heavy‑tailed, both in Euclidean space and on constrained domains. By adding a circulation drift through a divergence‑free skew‑symmetric matrix field and a stream potential, the methods preserve the target distribution without needing density derivatives, admit a random‑time‑change representation, and can be applied with normal reflection on bounded domains. The authors demonstrate that breaking reversibility leads to faster convergence to the target distribution, as shown by finite‑time non‑asymptotic analysis, large‑deviations results, and asymptotic variance reduction, with numerical experiments confirming the algorithms’ efficiency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
4d ago

Reflected Anchored Langevin Algorithms

The paper introduces Reflected Anchored Langevin Dynamics (RALD), a reflected diffusion that can converge to non‑differentiable target distributions on constrained domains. By employing a smooth anchored reference potential and scaling the drift and noise covariance with a state‑dependent factor, the authors derive an Euler‑Maruyama discretization with projection, yielding the Reflected Anchored Langevin Monte Carlo (RALMC) algorithm. Explicit convergence bounds and iteration complexity in the 2‑Wasserstein distance are proven, and numerical experiments confirm the theoretical predictions and empirical performance.

By Changwei Tu, Xiaoyu Wang, Yingli Wang, Xicheng Zhang, Lingjiong Zhu
diffusion
More like this →
arXiv Statistics ML
Oct 2

Langevin-Informed Transfer Learning: Replacing Target Samples by Black-Box Feedback

The paper introduces Langevin-Informed Transfer Learning (LITL), a method that recovers target Langevin dynamics from biased source samples using only black-box feedback. LITL learns the leading spectral structure of the target infinitesimal generator and the projected drift via Dirichlet representation learning, enabling kinetic reconstruction and slow-manifold gradient estimation. The authors provide finite-sample guarantees for eigenvalue, eigenfunction, and drift estimation, and demonstrate LITL’s ability to recover physical transition timescales, build kinetic structure from static generative samples, reconstruct spherical symmetries, and steer latent representations in trained neural networks.

By Vladimir R. Kostic, Karim Lounici, H\'el\`ene Halconruy, Timoth\'ee Devergne, Michele Parrinello, Massimiliano Pontil
diffusionfine-tuning
More like this →
Hugging Face Trending Papers
Aug 6

The Tamed Subgradient Unadjusted Langevin Algorithm beyond Convexity

We study the problem of sampling from target distributions whose potentials are simultaneously non-smooth, subject to superlinear gradient growth, and non-convex. We introduce the Subgradient Tamed Unadjusted Langevin Algorithm (SG-TULA), a discretisation of the Langevin diffusion that operates directly on subgradients, without relying on computationally demanding smoothing procedures.

llmsdiffusion
More like this →