arXiv Machine Learning

Sample Margin-Aware Recalibration of Temperature Scaling

The paper introduces SMART, a lightweight recalibration technique that adjusts logits based on the margin between the top two logits, called the logit gap. It uses a soft-binned Expected Calibration Error objective to balance bias and variance, enabling stable updates even with limited calibration data. Experiments across various datasets and architectures show SMART achieves state‑of‑the‑art calibration with fewer parameters than existing methods.

arXiv Machine Learning
Jul 10

LiST: Lipschitz Scaling Training for Robust and Calibrated Neural Networks

arXiv:2607. 07745v1 Announce Type: new Abstract: While accuracy, robustness, and calibration are all essential for reliable neural networks, they are often studied separately; developing models that satisfy all three simultaneously remains a central challenge.

By Arthur Chiron (IRIT, EPE UT), Franck Mamalet (IRIT, DTIPG - SNCF, UT3), Thomas Massena (IRIT, DTIPG - SNCF, UT3), Thomas Deltort (IRIT), Mathieu Serrurier (IRIT, UT2J)
arXiv AI
Oct 12

Calibration in One Go: Jointly Learning Accurate and Calibrated Neural Networks

The paper proposes a bilevel Stackelberg formulation that trains standard post‑hoc calibrators end‑to‑end with the neural network backbone, eliminating the need for a separate calibration dataset or dedicated loss. By jointly optimizing accuracy and calibration with cross‑entropy and a single calibrator learning‑rate hyperparameter, the method can use any calibrator type, but shows that the final classification layer alone suffices to produce accurate, well‑calibrated models. This approach outperforms state‑of‑the‑art calibrators while adding minimal complexity and avoiding the overhead of separate calibration components, especially beneficial in multi‑task learning settings.

By Nektarios Kalampalikis, Pablo M. Olmos, Isabel Valera
arXiv Computer Vision
Oct 23

Residual Calibration via Local Feature-Space Refinement

The paper introduces Local Adaptive Probability Estimation (LAPE), a post‑hoc residual calibration framework that refines global calibrator outputs using non‑parametric local evidence from neighboring samples in feature space. LAPE serves as a plug‑and‑play module that leverages feature‑space geometry and reuses calibration data, improving calibration quality for various baselines. The authors also extend the approach to multi‑view inputs with Cascade Feature Augmentation Fusion (CFAF) and demonstrate its effectiveness through extensive experiments.

By Xihao Wang, Chengyao Yu, Ruixing Ming
arXiv Machine Learning
Jul 3

Rethinking Post-Hoc Calibration in Semantic Segmentation

arXiv:2607. 01902v1 Announce Type: cross Abstract: Reliable confidence estimates are essential in semantic segmentation, especially in safety-critical settings where overconfident errors can mislead downstream decisions.

By Tristan Kirscher (ICube), Kim-Celine Kahl (DKFZ), Balint Kovacs (DKFZ), Maximilian R. Rokuss (DKFZ), Klaus Maier-Hein (DKFZ), Xavier Coubez (ICube), Philippe Meyer (ICube), Sylvain Faisan (ICube)