arXiv:2505.11335v5 Announce Type: replace
Abstract: Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness on graph-based tasks. However, their predictive confidence is often miscali...
By Jincheng Huang, Jie Xu, Xiaoshuang Shi, Ping Hu, Lei Feng, Xiaofeng Zhu
arXiv:2606. 28654v1 Announce Type: cross Abstract: Deep Neural Network (DNN) classifiers suffer from poor calibration when their softmax outputs (predictive confidence) deviate from the empirical likelihoods.
By Thiru Thillai Nadarasar Bahavan, Sachith Seneviratne, Saman Halgamuge
arXiv:2607. 10804v1 Announce Type: new Abstract: Graph neural networks (GNNs) are increasingly deployed in real-world applications where distribution shift is un-avoidable.
By Abderaouf Bahi
arXiv:2607. 07745v1 Announce Type: new Abstract: While accuracy, robustness, and calibration are all essential for reliable neural networks, they are often studied separately; developing models that satisfy all three simultaneously remains a central challenge.
By Arthur Chiron (IRIT, EPE UT), Franck Mamalet (IRIT, DTIPG - SNCF, UT3), Thomas Massena (IRIT, DTIPG - SNCF, UT3), Thomas Deltort (IRIT), Mathieu Serrurier (IRIT, UT2J)
The paper introduces SMART, a lightweight recalibration technique that adjusts logits based on the margin between the top two logits, called the logit gap. It uses a soft-binned Expected Calibration Error objective to balance bias and variance, enabling stable updates even with limited calibration data. Experiments across various datasets and architectures show SMART achieves state‑of‑the‑art calibration with fewer parameters than existing methods.
By Haolan Guo, Linwei Tao, Haoyang Luo, Minjing Dong, Chang Xu
arXiv:2505. 23866v2 Announce Type: replace Abstract: Deep neural networks have been increasingly used in safety-critical applications such as medical diagnosis and autonomous driving.
By Chengli Tan, Yubo Zhou, Haishan Ye, Guang Dai, Junmin Liu, Zengjie Song, Jiangshe Zhang, Zixiang Zhao, Yunda Hao, Yong Xu
arXiv:2605. 30188v2 Announce Type: replace-cross Abstract: Reliable probability estimates are critical in many machine learning applications, yet modern classifiers are often poorly calibrated.
By Eug\`ene Berta, David Holzm\"uller, Francis Bach, Michael I. Jordan
The paper introduces EUA‑Cal, a calibration method that preserves the early‑training uncertainty of deep neural networks. By regularizing predictions and feature prototypes based on the early model, EUA‑Cal mitigates overconfidence while maintaining accuracy. Experiments on image classification and multiple‑choice question answering across eight models show EUA‑Cal outperforms existing calibration techniques.
By Yutong Xie, Jiawei Tang, Zhenglin Hua, Yuxiang Ma, Si Qin, Yaxin Hou, Hui Liu, Junhui Hou, Yuheng Jia
The paper proposes a bilevel Stackelberg formulation that trains standard post‑hoc calibrators end‑to‑end with the neural network backbone, eliminating the need for a separate calibration dataset or dedicated loss. By jointly optimizing accuracy and calibration with cross‑entropy and a single calibrator learning‑rate hyperparameter, the method can use any calibrator type, but shows that the final classification layer alone suffices to produce accurate, well‑calibrated models. This approach outperforms state‑of‑the‑art calibrators while adding minimal complexity and avoiding the overhead of separate calibration components, especially beneficial in multi‑task learning settings.
By Nektarios Kalampalikis, Pablo M. Olmos, Isabel Valera
arXiv:2608. 10372v1 Announce Type: new Abstract: Post-hoc calibration aligns a classifier's predicted confidences with its empirical accuracy without retraining.
By Lening Zhao, Qipeng Zhan, Li Shen
arXiv:2608.30230v1 Announce Type: new
Abstract: Test-time prompt tuning (TPT) has emerged as a powerful paradigm, refining prompts for each test sample via entropy minimization (EM) over multiple aug...
By Jungwon Choi, Hyeonseo Jang, Kibok Lee, Eunwoo Kim
arXiv:2609.17386v1 Announce Type: new
Abstract: Test-time prompt tuning (TPT) enables adaptation on a single test instance, achieving improved accuracy but often sacrificing calibration performance....
By Yuwei Liang, Jian Liang, Dapeng Hu, Yinuo Xu, Ran He