arXiv Machine Learning

Anytime-Valid Confirmation of Label-Shift Corrections

arXiv:2606. 14028v1 Announce Type: cross Abstract: In small-batch scientific deployments, labeled target outcomes may be too scarce for reliable shift estimation even when unlabeled target inputs are available.

arXiv Machine Learning
Jul 10

Prediction-Powered Active Testing

arXiv:2607. 08347v1 Announce Type: cross Abstract: Active testing provides a label--efficient approach to risk estimation by adaptively selecting which test points should be labelled.

By Kianoosh Ashouritaklimi, Valentin Kilian, Daolang Huang, Tom Rainforth, Fran\c{c}ois Caron
arXiv Machine Learning
Jul 28

Robust Conformalized Selection with Noisy Responses

arXiv:2607. 22985v1 Announce Type: cross Abstract: Conformalized selection has been widely applied to select high-quality candidates from large datasets with rigorous uncertainty quantification, such as reliable labeling, drug discovery, and the alignment of large language models.

By Chengyao Yu, Hongxin Wei, Bingyi Jing
Hugging Face Trending Papers
Jul 9

Prediction-Powered Active Testing

Active testing provides a label--efficient approach to risk estimation by adaptively selecting which test points should be labelled. However, existing estimators fail to exploit the informative predictions of powerful black--box models, even though such predictions are increasingly available in settings where labels remain expensive.

arXiv Machine Learning
Jul 8

Factorizable joint shift revisited

arXiv:2601. 15036v4 Announce Type: replace Abstract: Factorizable joint shift (FJS) represents a type of distribution shift (or dataset shift) that comprises both covariate and label shift.

By Dirk Tasche