arXiv Statistics ML

Conformal Prediction under Exponential-Tilt Joint Shift

Hugging Face Trending Papers
Jun 10

Conformal Bayes under Label Shift: Post-Hoc Calibration vs. In-Training Adaptation

Conformal Bayes combines Bayesian posterior predictives with conformal calibration to produce prediction sets that are both statistically valid and geometrically efficient. We study conformal Bayes under label shift from a unified perspective, identifying two complementary approaches that restore nominal target-domain coverage through importance-weighted conformal calibration but operate through independent mechanisms.

arXiv Machine Learning
Sep 14

Split Conformal Prediction with Label-Shift-Adjusted Bayesian Scores

The paper introduces the Label-Shift-Adjusted Bayesian Score (LSA score), a nonconformity measure for conformal prediction that corrects Bayesian scores under label shift by applying an importance-weighted transformation of the source predictive distribution. Unlike residual-based scores that produce uniform-width intervals, the LSA score yields shorter, adaptive intervals while maintaining comparable coverage in the target domain. Experiments on molecular property prediction demonstrate that the LSA score outperforms both residual-based and source-based Bayesian scores, though all methods experience some coverage loss under stronger shifts due to density-ratio estimation challenges.

By Hyeonsu Lee, Juyeon Kim, Erkhembayar Jadamba, Seungjin Choi, Hyunjin Shin
arXiv Machine Learning
Sep 11

Conformal Calibration Transfer

Conformal Calibration Transfer addresses the challenge of applying conformal prediction when labeled calibration data is only available in a source space, while predictions are needed in a target space linked via unlabeled paired observations. The proposed Transported Conformal Calibration (TCC) method transports source calibration into the target domain and then corrects residual mismatches using only unlabeled target inputs, with two variants: TCC‑KS, which conservatively adjusts calibration based on a label‑free uncertainty surrogate, and weighted‑TCC, which reweights transported calibration for efficiency when weights are stable. Finite‑sample target‑domain coverage guarantees are provided, and experiments on CIFAR‑100‑C, Tiny‑ImageNet‑C, and SEN12MS demonstrate reliable coverage transfer without labeled target data, along with label‑free diagnostics to signal when correction is required.

By Achref Doula
arXiv Machine Learning
Aug 4

Conformalized Large Language Models under Configuration Shift

arXiv:2608. 01460v1 Announce Type: new Abstract: Conformal prediction (CP) is a distribution-free framework for uncertainty quantification that has recently been adapted to large language models (LLMs), providing prediction sets with finite-sample coverage guarantees under exchangeability.

By Yuqicheng Zhu, Jialin Yu, Lin Li, Gengyuan Zhang, Zhen Yang, Steffen Staab, Puneet Dokania, Philip Torr, Jie Tang, Evgeny Kharlamov