arXiv Statistics ML
A Three-Way Testing Framework for Quantifying Epistemic Calibration Uncertainty in SBI
Read the original on arXiv Statistics ML →The Flow has not summarised this story yet — read it at arXiv Statistics ML.
Related stories
arXiv Machine Learning
Jun 11
CP4SBI: Local Conformal Calibration of Credible Sets in Simulation-Based Inference
arXiv:2508. 17077v3 Announce Type: replace-cross Abstract: Current experimental scientists have been increasingly relying on simulation-based inference (SBI) to invert complex non-linear models with intractable likelihoods.
arXiv Machine Learning
Jun 10
Can we trust our models? Epistemic calibration in second-order classification
arXiv:2606. 10777v1 Announce Type: new Abstract: Uncertainty estimation is critical for deploying machine learning models in high-stakes settings.
arXiv Machine Learning
Jun 4
Flow Matching Calibration for Simulation-Based Inference under Model Misspecification
arXiv:2509. 23385v5 Announce Type: replace-cross Abstract: Simulation-based inference (SBI) is transforming experimental sciences by enabling parameter estimation in complex non-linear models from simulated data.
arXiv Statistics ML
3d ago
Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods
arXiv:2609.39712v1 Announce Type: cross Abstract: We consider simulation-based Bayesian inference (SBI) for the parameters of models with intractable likelihoods but tractable forward simulation. Bui...
arXiv Machine Learning
Sep 14
A Ranking Approach for Measuring Calibration
The paper introduces rankECE, a new metric for assessing calibration error in predictive models. Unlike the widely used Expected Calibration Error (ECE), rankECE compares predictions with neighboring probability values, offering theoretical guarantees and empirical evidence that it better approximates ECE than traditional binned methods.
arXiv Machine Learning
Jul 23
A Confidence Interval for the $\ell_2$ Expected Calibration Error
arXiv:2408. 08998v4 Announce Type: replace-cross Abstract: Recent advances in machine learning have significantly improved prediction accuracy in various applications.