arXiv Machine Learning

Beyond Prediction-Set Size: Quantifying Conformal Uncertainty through Credal Geometry

The paper extends conformal prediction by introducing a geometric view of uncertainty through credal sets, which are families of probability distributions compatible with CP regions. It provides analytical characterisations and efficient algorithms for common credal uncertainty measures, reducing complexity from exponential to linear after sorting p-values. The authors also unify these measures with classical conformal summaries using Tsallis entropy penalties, prove an impossibility theorem for split-conformal regression, and demonstrate through experiments that the new summaries recover ranking information lost by prediction-set size, enabling finer-grained uncertainty assessment.

arXiv Machine Learning
Jun 3

Set-Preserving Calibration from Conformal P-Values to E-Values

arXiv:2606. 03600v1 Announce Type: cross Abstract: Standard conformal prediction (CP) procedures are typically formulated in terms of p-values, but reliance on p-values alone limits flexibility, for example, when combining dependent evidence across models or data splits.

By Nabil Alami, Jad Zakharia, Souhaib Ben Taieb
arXiv Machine Learning
Jul 9

Optimal Conformal Prediction under Epistemic Uncertainty

arXiv:2505. 19033v2 Announce Type: replace-cross Abstract: Conformal prediction (CP) is a widely used frequentist framework to quantify uncertainty by constructing prediction sets with user-specified marginal coverage guarantees.

By Alireza Javanmardi, Soroush H. Zargarbashi, Santo M. A. R. Thies, Willem Waegeman, Aleksandar Bojchevski, Eyke H\"ullermeier
arXiv Machine Learning
Jul 1

On Optimal Data Splitting for Split Conformal Prediction

arXiv:2606. 31600v1 Announce Type: cross Abstract: Conformal prediction and its variants, including the split conformal prediction, provide a distribution-free framework for uncertainty quantification by constructing prediction intervals or sets with finite-sample coverage guarantees.

By Sayan Das, Bahram Yaghooti, Todd A. Kuffner, Soumendra N. Lahiri
arXiv Statistics ML
Sep 1

Elements of Conformal Prediction

arXiv:2603.23923v2 Announce Type: replace-cross Abstract: Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution an...

By Matteo Sesia, Stefano Favaro
arXiv Machine Learning
Sep 24

Tail-Aware Geometry Learning for Conformal Ellipsoids

The paper introduces a tail‑aware geometry learning framework for multivariate conformal prediction using ellipsoids. It decouples tail sensitivity from coverage guarantees by learning a metric matrix through volume minimization under a CVaR constraint, followed by standard conformal calibration. The approach is convex, prioritizes high‑residual samples, and theoretically balances ellipsoidal volume against tail severity, with experiments confirming its effectiveness.

By Xiang Zhang
arXiv Machine Learning
Jul 9

Approximate full conformal prediction in an RKHS

arXiv:2601. 13102v3 Announce Type: replace-cross Abstract: Full conformal prediction is a framework that implicitly formulates distribution-free confidence prediction regions for a wide range of estimators.

By Davidson Lova Razafindrakoto, Alain Celisse, J\'er\^ome Lacaille
arXiv Machine Learning
Jul 21

Isotonic Conformal Prediction

arXiv:2607. 16675v1 Announce Type: cross Abstract: A point prediction that is well calibrated on average can still be systematically biased conditional on its own value, undermining its use in downstream decision-making.

By Daniel Bensimon, Sean Xiang Yu, Eric D. Kolaczyk, Archer Y. Yang