Estimating Performance for Safe Deployment of Machine Learning Models

The paper introduces MOVAL, a model evaluation tool that estimates performance of deep neural networks on unlabeled test data by calibrating class-wise confidence scores. MOVAL mitigates issues from distributional shifts and class imbalance, enabling estimation of metrics beyond accuracy such as F1-Score and AUC. Experiments on natural and medical image datasets demonstrate state‑of‑the‑art results across classification and segmentation tasks, providing accurate class, instance, and pixel‑level performance estimates for safe deployment.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

• computer-vision
• benchmarks
• safety