arXiv Machine Learning

Threshold-Aware Conformal Routing

Threshold-Aware Conformal Routing (TACR) is a method that decides whether to use a fast surrogate model or a full simulator based on whether the surrogate’s conformal interval lies entirely on one side of a fixed decision threshold. TACR learns input‑dependent interval widths that are tighter near the threshold, preserving distribution‑free coverage while reducing the number of simulator calls. Experiments on scientific and engineering datasets show TACR cuts simulator deferrals by 14‑75% compared to standard conformal prediction, and by an additional 10‑24% over a variant without threshold‑aware weighting.

arXiv Machine Learning
1d ago

Selection-Safe Conformal Early Exit: Distribution-Free Coverage under Adaptive Depth

The paper introduces a selection‑safe conformal early‑exit method that calibrates a single split‑conformal quantile using a terminal‑path score derived from prefix maxima. This approach guarantees coverage for any data‑dependent stopping policy that preserves terminal‑set containment, without requiring an α/L correction. Empirical results on eight encoder backbones and CIFAR‑100 show that pathwise selection achieves higher macro coverage (0.901 vs. 0.814) with smaller set sizes and lower latency fractions compared to naive layer‑wise selection, and remains robust to deployment‑time budget changes.

By Adria Binte Habib, Ibne Farabi Shihab
arXiv Machine Learning
Oct 5

Coverage You Can Steer: Online Conformal Calibration for RL-Driven Hardware-Aware NAS

The paper introduces Adaptive Conformal Inference, an online calibration method that replaces static quantile estimation in hardware‑aware neural architecture search (NAS). By providing distribution‑free guarantees that at most a fraction δ of candidates are wrongly discarded, the method maintains steerable coverage across arbitrary sequences of reinforcement‑learning proposals. Experiments on three neural‑network families show that it tracks requested coverage levels within ~10⁻³ while pruning 25–50% of evaluations without accuracy loss, outperforming static calibration and a Gaussian‑process baseline.

By Pedro Brandimarte, Nerea Aranjuelo, Marcos Nieto, Oihana Otaegui
arXiv Machine Learning
Aug 26

Replicable Conformal Prediction

arXiv:2608.23638v1 Announce Type: cross Abstract: Two analysts who calibrate the same predictive model on independent samples will deploy different prediction sets every time, because the calibration...

By Marios Papamichalis, Regina Ruane, Theofanis Papamichalis
arXiv Machine Learning
5d ago

CopRoute: Dependence-Aware Conformal Routing for Language Models

CopRoute introduces a dependence-aware conformal routing method for language models that orders models by the number of new queries each correctly answers beyond those already covered, selecting the minimal cutoff that satisfies a target all‑miss risk. This approach accounts for model failure dependencies—such as shared training data or architecture—that traditional risk‑controlled policies ignore. Experiments on RouterBench and RouterEval show CopRoute achieves fewer certified inference calls than state‑of‑the‑art methods, reducing calls by up to 79 % in some cases while maintaining the same risk level.

By Siva Rajesh Kasa, Santhosh Kumar Kasa, Karan Gupta