arXiv AI

PQMass: Probabilistic Assessment of the Quality of Generative Models using Probability Mass Estimation

arXiv AI
Jun 24

MGI: Member vs Generated Inference

arXiv:2606. 23872v1 Announce Type: cross Abstract: As generative models increasingly produce samples that are indistinguishable from human-created content, it becomes difficult to determine whether a given data point was part of a model's natural training set or was generated by the model itself, especially when models memorize and reproduce training data.

By Bihe Zhao, Michel Meintz, Juangui Xu, Franziska Boenisch, Adam Dziedzic
arXiv AI
Jun 11

A New Perspective on Precision and Recall for Generative Models

arXiv:2511. 02414v3 Announce Type: replace Abstract: With the recent success of generative models in image and text, the question of their evaluation has recently gained a lot of attention.

By Benjamin Sykes (Unicaen, Ensicaen, Greyc), Lo\"ic Simon (Unicaen, Ensicaen, Greyc), Julien Rabin (Unicaen, Ensicaen, Greyc), Jalal Fadili (Unicaen, Ensicaen, Greyc)
arXiv Machine Learning
Sep 11

Local Robustness Quantification for Naive Bayes Classifiers and Generative Forests: a General Approach

The paper introduces techniques for measuring the robustness of predictions made by two generative classifiers—naive Bayes classifiers and generative forests—whose underlying models are probabilistic graphical models. Robustness is defined as the degree to which the classifier’s distribution can be perturbed without altering its prediction, with perturbations explored via epsilon‑contamination, total variation distance, and chi‑squared divergence neighborhoods. Experiments on benchmark datasets show that the computed robustness values can serve as indicators of prediction trustworthiness and are compared against other existing indicators.

By Adri\'an Detavernier, Jasper De Bock