arXiv Machine Learning

A Theoretical Framework for Statistical Evaluability of Generative Models

arXiv:2604. 05324v2 Announce Type: replace Abstract: Statistical evaluation aims to estimate the generalization performance of a model using held-out i.

arXiv AI
Jul 29

Generative Distributionally Robust Optimization

arXiv:2607. 24983v1 Announce Type: cross Abstract: Generative models are increasingly adopted in distributionally robust optimization (DRO), but existing approaches trade off model compatibility and adversarial structure: methods that accept arbitrary samplers do not restrict worst-case laws to a generator family, while generator-parameterized adversaries rely on model-specific access such as likelihoods, scores, or training data.

By Ziwei Zhang, Jonathan Yu-Meng Li, Zhihao Jin
arXiv AI
Jun 11

A New Perspective on Precision and Recall for Generative Models

arXiv:2511. 02414v3 Announce Type: replace Abstract: With the recent success of generative models in image and text, the question of their evaluation has recently gained a lot of attention.

By Benjamin Sykes (Unicaen, Ensicaen, Greyc), Lo\"ic Simon (Unicaen, Ensicaen, Greyc), Julien Rabin (Unicaen, Ensicaen, Greyc), Jalal Fadili (Unicaen, Ensicaen, Greyc)
arXiv Machine Learning
Sep 11

Local Robustness Quantification for Naive Bayes Classifiers and Generative Forests: a General Approach

The paper introduces techniques for measuring the robustness of predictions made by two generative classifiers—naive Bayes classifiers and generative forests—whose underlying models are probabilistic graphical models. Robustness is defined as the degree to which the classifier’s distribution can be perturbed without altering its prediction, with perturbations explored via epsilon‑contamination, total variation distance, and chi‑squared divergence neighborhoods. Experiments on benchmark datasets show that the computed robustness values can serve as indicators of prediction trustworthiness and are compared against other existing indicators.

By Adri\'an Detavernier, Jasper De Bock