arXiv Machine Learning

Conformal Prediction with Macro-Coverage Guarantees

arXiv:2606. 28598v1 Announce Type: cross Abstract: Prediction sets should have high coverage to be useful, but some coverage notions are more practically relevant than others.

arXiv Machine Learning
Sep 11

Benchmarking non-conformity score functions in conformal prediction

Conformal prediction replaces single-class predictions with prediction sets that guarantee a pre-specified coverage probability. The paper reviews properties of non‑conformity score functions, presents examples from the literature, and proposes new modifications. It introduces a method to evaluate prediction set sizes and compares different score functions, including their effectiveness for class‑conditional conformal prediction with imbalanced classes.

By Sol Erika Boman
arXiv Machine Learning
Sep 15

Noise-Adaptive Conformal Classification with Marginal Coverage

arXiv:2501.18060v2 Announce Type: replace-cross Abstract: Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated pr...

By Teresa Bortolotti, Y. X. Rachel Wang, Xin Tong, Alessandra Menafoglio, Simone Vantini, Matteo Sesia
arXiv Machine Learning
Jul 10

Multi-Distribution Robust Conformal Prediction

arXiv:2601. 02998v2 Announce Type: replace Abstract: In many fairness and distribution robustness problems, one has access to labeled data from multiple source distributions yet the test data may come from an arbitrary member or a mixture of them.

By Yuqi Yang, Ying Jin
arXiv Machine Learning
Jul 9

Optimal Conformal Prediction under Epistemic Uncertainty

arXiv:2505. 19033v2 Announce Type: replace-cross Abstract: Conformal prediction (CP) is a widely used frequentist framework to quantify uncertainty by constructing prediction sets with user-specified marginal coverage guarantees.

By Alireza Javanmardi, Soroush H. Zargarbashi, Santo M. A. R. Thies, Willem Waegeman, Aleksandar Bojchevski, Eyke H\"ullermeier