arXiv Statistics ML

Distributionally robust linear regression through the lens of adversarial training

arXiv:2609. 39449v1 Announce Type: new Abstract: Distributionally robust optimization (DRO) studies parameter estimation under uncertainty in the underlying probability distribution and has emerged as a principled framework for analyzing robustness and generalization.

arXiv Machine Learning
Sep 30

Learning Distributionally Robust First-Order Methods for Convex Optimization

The paper introduces a distributionally robust method for learning hyperparameters of first‑order convex optimization algorithms. By minimizing a Wasserstein‑robust performance estimation problem over a dataset of problem instances, the approach interpolates between classical learning‑to‑optimize (L2O) and worst‑case PEP design. The authors solve the resulting problem with stochastic gradient descent, provide high‑probability risk bounds, and demonstrate that the learned algorithms outperform both worst‑case optimal and vanilla L2O baselines on logistic regression, LASSO, and linear programming tasks.

By Vinit Ranjan, Jisun Park, Bartolomeo Stellato
arXiv Machine Learning
Jun 30

Wasserstein Distributionally Robust Regret Optimization

arXiv:2504. 10796v4 Announce Type: replace-cross Abstract: Distributionally robust optimization (DRO) is widely used for decision-making under uncertainty, but its adversarial focus on worst-case loss can lead to overly conservative policies.

By Lukas-Benedikt Fiechtner, Jose Blanchet
arXiv Machine Learning
Oct 21

Wasserstein Robust Classification Error: Surrogate Loss Misalignment and Distributional Attacks

The paper investigates Wasserstein distributionally robust optimization (WDRO) for classification, showing that ordering hypotheses by WDRO risk aligns with robust accuracy only for a specific class of loss functions. It demonstrates that common losses like cross‑entropy can misalign robust accuracy and WDRO risk, and introduces Wasserstein distributional attacks (WDA) with a support‑search algorithm to directly evaluate robust accuracy. Experiments on CIFAR‑10, CIFAR‑100, and ImageNet reveal that WDA achieves the lowest adversarial accuracy in most settings.

By Bach C. Le, Tung V. Dao, Binh T. Nguyen, Hong T. M. Chu