arXiv Machine Learning

Trust-Region Optimization for Smooth Potential-Interaction Energies in Wasserstein Space

arXiv:2610. 08883v1 Announce Type: cross Abstract: Finding low-energy configurations of interacting particles and approximating probability distributions lead to the minimization of potential-interaction energies in Wasserstein space.

arXiv Machine Learning
Sep 1

Quantitative Target Convergence and Uniform-in-Time Propagation of Chaos for Langevin-Regularized SVGD

The paper proves quantitative convergence to the target distribution and uniform‑in‑time propagation of chaos for Langevin‑regularized Stein variational gradient descent (SVGD). It shows that both the Stein interaction and the Langevin drift dissipate the same relative entropy, yielding exponential convergence under a log‑Sobolev inequality and providing finite‑particle entropy identities for empirical measures. Two finite‑time approaches—synchronous coupling and moving‑product entropy—are developed to give explicit Wasserstein, kernel Stein discrepancy, and total variation bounds, leading to polynomial uniform‑in‑time propagation of chaos rates.

By Sayan Banerjee, Dohyeon Kim
arXiv Machine Learning
Jun 30

Wasserstein Distributionally Robust Regret Optimization

arXiv:2504. 10796v4 Announce Type: replace-cross Abstract: Distributionally robust optimization (DRO) is widely used for decision-making under uncertainty, but its adversarial focus on worst-case loss can lead to overly conservative policies.

By Lukas-Benedikt Fiechtner, Jose Blanchet
arXiv Machine Learning
Sep 23

Penalized Nonreversible Langevin for Constrained Sampling

The paper introduces penalized nonreversible Langevin algorithms for sampling from a target distribution constrained to a compact convex set. It combines a squared distance penalty with skew-symmetric perturbations that preserve the penalized Gibbs distribution, and provides nonasymptotic total variation and Wasserstein bounds under various smoothness and contraction assumptions. Numerical experiments demonstrate the methods on constrained Bayesian regression, classification, neural networks, and truncated sampling, highlighting acceleration in a stochastic quadratic model.

By Pervez Ali, Weihao Dong, Xiaoyu Wang
arXiv Machine Learning
Sep 15

Riemannian ascent--descent for nonconvex nonconcave minimax landscapes: convergence to basin saddle points and applications to distributionally robust optimization

The paper introduces a new convergence framework for solving distributionally robust optimization problems formulated as nonconvex, nonconcave minimax problems over a Euclidean space and a Riemannian manifold. It defines a "basin saddle point"—a locally defined Nash equilibrium—and proves that a Riemannian gradient ascent–descent algorithm converges to such points under a local Łojasiewicz growth condition. The authors apply this theory to a statistical risk DRO problem over Gaussian measures, deriving explicit convergence rates and constants in terms of data dimension, loss moments, and reference covariance.

By Rishabh Dixit, Pranav Upadrashta, Alex Cloninger