arXiv Machine Learning
Replicable Conformal Prediction
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Aug 24
The Exceedance Design Effect: Effective Sample Size for Thresholds under Clustering
arXiv:2608.21262v1 Announce Type: cross Abstract: Many machine-learning systems set a threshold at a quantile of a calibration set: conformal predictors that promise 90% coverage by drawing their cut...
arXiv Statistics ML
Oct 8
Sketched Calibration for Conformal Prediction under Covariate Shift
arXiv:2610.09208v1 Announce Type: cross Abstract: Weighted conformal prediction corrects for covariate shift by reweighting calibration scores with the likelihood ratio between target and source cova...
arXiv Machine Learning
Aug 26
Calibration-Preserving Pruning: Compression as a Reliability Contract
arXiv:2608.23744v1 Announce Type: new Abstract: Split conformal prediction, not the pruning rule, supplies finite-sample marginal coverage once a pruned model is fixed independently of the conformal...
arXiv Machine Learning
Jul 21
Isotonic Conformal Prediction
arXiv:2607. 16675v1 Announce Type: cross Abstract: A point prediction that is well calibrated on average can still be systematically biased conditional on its own value, undermining its use in downstream decision-making.
arXiv Machine Learning
Jul 21
The Label Complexity of Class-Conditional Coverage under Distribution Shift
arXiv:2607. 18088v1 Announce Type: new Abstract: Standard evaluation of many recognition systems contains distribution shift by construction, since benchmarks place disjoint conditions in the training and test splits.
arXiv Machine Learning
Oct 9
Conformal Prediction under Partial Verification
The paper introduces a partial verification approach for conformal prediction that yields the same prediction sets as full verification. It defines calibration certificates—minimal verified information needed to set the conformal threshold—and presents a coordinated verification procedure. The method reduces verification cost by 15–82% compared to sequential verification while maintaining identical prediction sets.