arXiv Machine Learning

Conformal Prediction under Partial Verification

The paper introduces a partial verification approach for conformal prediction that yields the same prediction sets as full verification. It defines calibration certificates—minimal verified information needed to set the conformal threshold—and presents a coordinated verification procedure. The method reduces verification cost by 15–82% compared to sequential verification while maintaining identical prediction sets.

arXiv Machine Learning
Jun 3

Set-Preserving Calibration from Conformal P-Values to E-Values

arXiv:2606. 03600v1 Announce Type: cross Abstract: Standard conformal prediction (CP) procedures are typically formulated in terms of p-values, but reliance on p-values alone limits flexibility, for example, when combining dependent evidence across models or data splits.

By Nabil Alami, Jad Zakharia, Souhaib Ben Taieb
arXiv Machine Learning
Sep 11

Benchmarking non-conformity score functions in conformal prediction

Conformal prediction replaces single-class predictions with prediction sets that guarantee a pre-specified coverage probability. The paper reviews properties of non‑conformity score functions, presents examples from the literature, and proposes new modifications. It introduces a method to evaluate prediction set sizes and compares different score functions, including their effectiveness for class‑conditional conformal prediction with imbalanced classes.

By Sol Erika Boman
arXiv Machine Learning
Aug 26

Replicable Conformal Prediction

arXiv:2608.23638v1 Announce Type: cross Abstract: Two analysts who calibrate the same predictive model on independent samples will deploy different prediction sets every time, because the calibration...

By Marios Papamichalis, Regina Ruane, Theofanis Papamichalis
arXiv Machine Learning
Sep 11

Conformal Calibration Transfer

Conformal Calibration Transfer addresses the challenge of applying conformal prediction when labeled calibration data is only available in a source space, while predictions are needed in a target space linked via unlabeled paired observations. The proposed Transported Conformal Calibration (TCC) method transports source calibration into the target domain and then corrects residual mismatches using only unlabeled target inputs, with two variants: TCC‑KS, which conservatively adjusts calibration based on a label‑free uncertainty surrogate, and weighted‑TCC, which reweights transported calibration for efficiency when weights are stable. Finite‑sample target‑domain coverage guarantees are provided, and experiments on CIFAR‑100‑C, Tiny‑ImageNet‑C, and SEN12MS demonstrate reliable coverage transfer without labeled target data, along with label‑free diagnostics to signal when correction is required.

By Achref Doula
arXiv Machine Learning
Jul 21

Isotonic Conformal Prediction

arXiv:2607. 16675v1 Announce Type: cross Abstract: A point prediction that is well calibrated on average can still be systematically biased conditional on its own value, undermining its use in downstream decision-making.

By Daniel Bensimon, Sean Xiang Yu, Eric D. Kolaczyk, Archer Y. Yang
arXiv Machine Learning
Sep 15

Noise-Adaptive Conformal Classification with Marginal Coverage

arXiv:2501.18060v2 Announce Type: replace-cross Abstract: Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated pr...

By Teresa Bortolotti, Y. X. Rachel Wang, Xin Tong, Alessandra Menafoglio, Simone Vantini, Matteo Sesia