arXiv Machine Learning

Generalized Conformal Predictive Systems Under Distributional Shifts

arXiv:2606. 11044v1 Announce Type: cross Abstract: Conformal predictive systems (CPS) output calibrated bands of CDFs under exchangeability.

arXiv Machine Learning
Jun 3

Set-Preserving Calibration from Conformal P-Values to E-Values

arXiv:2606. 03600v1 Announce Type: cross Abstract: Standard conformal prediction (CP) procedures are typically formulated in terms of p-values, but reliance on p-values alone limits flexibility, for example, when combining dependent evidence across models or data splits.

By Nabil Alami, Jad Zakharia, Souhaib Ben Taieb
arXiv Machine Learning
Aug 19

Conformal Prediction for Molecular Properties under Label Shift

The paper introduces a conformal prediction framework designed for molecular property prediction under label shift. By weighting conformal scores with marginal label probability ratios, it generates statistically rigorous prediction intervals without retraining, enabling robust uncertainty quantification when property distributions change. This approach provides actionable confidence measures that improve the reliability of AI-driven predictions in drug discovery.

By Hyeonsu Lee, Juyeon Kim, Erkhembayar Jadamba, Seungjin Choi, Hyunjin Shin
arXiv Machine Learning
Sep 14

Split Conformal Prediction with Label-Shift-Adjusted Bayesian Scores

The paper introduces the Label-Shift-Adjusted Bayesian Score (LSA score), a nonconformity measure for conformal prediction that corrects Bayesian scores under label shift by applying an importance-weighted transformation of the source predictive distribution. Unlike residual-based scores that produce uniform-width intervals, the LSA score yields shorter, adaptive intervals while maintaining comparable coverage in the target domain. Experiments on molecular property prediction demonstrate that the LSA score outperforms both residual-based and source-based Bayesian scores, though all methods experience some coverage loss under stronger shifts due to density-ratio estimation challenges.

By Hyeonsu Lee, Juyeon Kim, Erkhembayar Jadamba, Seungjin Choi, Hyunjin Shin
arXiv Machine Learning
Jul 21

Isotonic Conformal Prediction

arXiv:2607. 16675v1 Announce Type: cross Abstract: A point prediction that is well calibrated on average can still be systematically biased conditional on its own value, undermining its use in downstream decision-making.

By Daniel Bensimon, Sean Xiang Yu, Eric D. Kolaczyk, Archer Y. Yang
arXiv Statistics ML
Sep 1

Elements of Conformal Prediction

arXiv:2603.23923v2 Announce Type: replace-cross Abstract: Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution an...

By Matteo Sesia, Stefano Favaro
arXiv Statistics ML
6d ago

Multivariate conformal uncertainty propagation in multitask atomistic simulation: Successes and pitfalls

The paper explores multivariate conformal uncertainty propagation for multitask atomistic simulations, introducing methods such as Bonferroni‑corrected hyperrectangles, hyperellipsoidal sets based on Mahalanobis distance, and custom loss functions within conformal risk control. It applies these techniques to calibrate predictions of energies, forces, and stresses, then propagates the resulting uncertainty sets to downstream quantities like elastic constants and vacancy formation energies. The study emphasizes how incorporating correlation predictions can capture symmetries and error cancellation, and discusses the interaction between computational protocols and conformal guarantees.

By Katharine Fisher, Michael Herbst, James Kermode, Youssef Marzouk