arXiv AI
Uncertainty Evaluation: Bridging Machine Learning and Measurement Science
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 10
Can we trust our models? Epistemic calibration in second-order classification
arXiv:2606. 10777v1 Announce Type: new Abstract: Uncertainty estimation is critical for deploying machine learning models in high-stakes settings.
arXiv Machine Learning
Jul 7
An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression
arXiv:2504. 18433v3 Announce Type: replace Abstract: Uncertainty quantification is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and evaluations.
arXiv Machine Learning
Jun 11
What Uncertainties Do We Need for Dynamical Systems?
arXiv:2606. 11988v1 Announce Type: new Abstract: The distinction between aleatoric and epistemic uncertainty has received considerable attention in machine learning research, mainly in the context of supervised learning but also in other settings such as generative modeling.
arXiv AI
Jul 17
Subjective Risk Decomposition: A New View for Uncertainty Quantification
arXiv:2607. 15196v1 Announce Type: cross Abstract: We present a novel viewpoint for uncertainty quantification.
arXiv AI
Jun 26
Decision-Aligned Evaluation of Uncertainty Quantification
arXiv:2606. 26990v1 Announce Type: cross Abstract: Uncertainty estimates in machine learning are typically evaluated using generic metrics such as the negative log-likelihood and expected calibration error, yet good performance on such metrics does not necessarily imply high utility in downstream decisions.
arXiv Machine Learning
Sep 4
Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review
The review examines how Uncertainty Quantification (UQ) can enhance machine learning applied to biosignals such as EEG, ECG, EOG, and EMG. It surveys 53 papers, outlining current methods, shortcomings, and theoretical frameworks, while highlighting misconceptions and gaps in diagnostic and prosthetic control contexts. The authors recommend further research on human-system interaction with UQ models in clinical settings.