arXiv Machine Learning

Conformalized Quantile Regression and Minimax Limits of Fixed-Score Calibration under Known Covariate Shift

arXiv Machine Learning
Aug 7

Beyond Marginal Validity: Finite-Sample Guarantees for Localized Conformal Prediction

arXiv:2608. 06206v1 Announce Type: cross Abstract: Conformal prediction endows arbitrary black-box predictors with finite-sample, distribution-free marginal coverage, yet marginal validity can hide severe covariate-specific miscalibration, while exact distribution-free conditional coverage is finite-sample unattainable.

By Anton Conrad, Rustam Isaev, Denis Belomestny, Eric Moulines, Sergey Samsonov
Hugging Face Trending Papers
Sep 2

Occupancy-based Quantile Risk Control

Occupancy-based Quantile Risk Control (OQRC) is a new method that extends conformal risk control to quantile-based risk measures while avoiding excessive conservatism and providing rigorous finite-sample guarantees. It works by partitioning the loss space using ordered calibration losses, estimating the distribution of test losses in each bin, and bounding the risk by the maximum loss in each bin. The authors prove that OQRC achieves tight risk control bounds with a finite-sample guarantee that converges at a rate of π(n−½), and experiments show it can reduce the risk gap by up to 78.64% on common benchmarks.

arXiv Machine Learning
Sep 4

Occupancy-based Quantile Risk Control

Occupancy-based Quantile Risk Control (OQRC) is a new method that extends conformal risk control to quantile-based risk measures. It partitions the loss space using ordered calibration losses, estimates the distribution of test losses in each bin, and upper-bounds the risk by the maximum loss per bin. The approach guarantees finite-sample validity, achieving tight risk control bounds that converge at a rate of σ(n^{-1/2}) and reducing the risk gap by up to 78.64% in experiments.

By Zihao Shi, Huajun Xi, Bingyi Jing, Hongxin Wei