arXiv Machine Learning

On the Optimisation Landscape of Overparameterised Weighted MMD

arXiv Statistics ML
Oct 2

Muon meets Tamed Langevin: Momentum Preconditioning beyond Convex and gradient-Lipschitz Potentials

The paper introduces a new underdamped Langevin system for sampling Gibbs distributions on matrix spaces where the potential energy is neither convex nor globally gradient‑Lipschitz. By employing non‑quadratic kinetic energies, the authors achieve momentum preconditioning that smooths the momentum via a spectral taming of its gradient. They prove that this dynamics preserves the target Gibbs measure, converges exponentially fast in a weighted total variation distance, and that its Euler–Maruyama discretization remains stable with uniform moment bounds over time.

By Nikolaos Makras, Sotirios Sabanis
Hugging Face Trending Papers
Aug 6

The Tamed Subgradient Unadjusted Langevin Algorithm beyond Convexity

We study the problem of sampling from target distributions whose potentials are simultaneously non-smooth, subject to superlinear gradient growth, and non-convex. We introduce the Subgradient Tamed Unadjusted Langevin Algorithm (SG-TULA), a discretisation of the Langevin diffusion that operates directly on subgradients, without relying on computationally demanding smoothing procedures.

arXiv Machine Learning
Aug 13

Fine-Tuning Generative Models for Extreme Events via CVaR-Penalized Wasserstein Gradient Flows

arXiv:2608. 11544v1 Announce Type: cross Abstract: We propose CVaR-penalized Generative Particle Algorithm (CVaR-GPA), a robust, tail-agnostic algorithm for fine-tuning generative models to learn heavy-tailed distributions and capture extreme events, requiring no prior knowledge or estimation of the target's tail characteristics.

By Thejani Gamage, Hyemin Gu, Zhizhen Zhang, Ziyu Chen, Markos Katsoulakis, Luc Rey-Bellet