arXiv Machine Learning August 7, 2026 By Frieder Wizgall, Georg Tirpitz, Moritz Seiler, Kerstin Ritter, B\'alint Mucs\'anyi

A Unified Risk View of Uncertainty: Posterior Risk for Disentanglement and Evaluation Beyond Proxies

Read the original on arXiv Machine Learning →

arXiv:2608. 05995v1 Announce Type: new Abstract: Reliable uncertainty estimates are critical in safety-sensitive applications, where understanding the sources of predictive uncertainty is essential.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

1d ago

A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk

The paper introduces a ground‑truth framework for disentangling uncertainty into epistemic and aleatoric components using sample‑conditional pointwise posterior risk. It evaluates current methods, finding that Spectral‑normalized Neural Gaussian Processes and Variational Latent Gaussian Processes best recover the ground‑truth uncertainty, while most methods align more closely with posterior variance and miss predictor bias. The study also explores the entanglement of estimated uncertainties and the impact of modeling choices, providing practical guidance and releasing 13 semi‑synthetic datasets for further validation.

By Frieder Wizgall, Georg Tirpitz, Moritz Seiler, Kerstin Ritter, B\'alint Mucs\'anyi

benchmarks safety

arXiv Machine Learning

Jun 19

Quantifying Aleatoric Uncertainty of In-Context Learning for Robust Measure of LLM Prediction Confidence

arXiv:2606. 19353v1 Announce Type: cross Abstract: In-Context Learning (ICL) allows LLMs to adapt to new tasks from a few demonstrations, but its reliability remains a concern: predictions are highly sensitive to both prompt design and the model's ability to understand the context, obscuring whether failures arise from data properties or model limitations.

By Jinseok Chung, Minkyoung Song, Hyunji Jung, Namhoon Lee

llms benchmarks safety

arXiv AI

Jul 17

Evaluating Epistemic Uncertainty: Beyond OOD Detection and Active Learning

arXiv:2607. 14817v1 Announce Type: cross Abstract: Current evaluation of epistemic uncertainty relies on tasks such as out-ofdistribution detection and active learning.

By Jakub Paplh\'am, Willem Waegeman, Eyke H\"ullermeier, Vojt\v{e}ch Franc

benchmarks

arXiv Machine Learning

Jun 4

Variance-Gated Ensembles: An Epistemic-Aware Framework for Uncertainty Estimation

arXiv:2602. 08142v2 Announce Type: replace Abstract: Machine learning applications require fast and reliable per-sample uncertainty estimation.

By H. Martin Gillis, Isaac Xu, Thomas Trappenberg

benchmarks

arXiv Machine Learning

Aug 4

Nonparametric Distribution Regression Re-calibration

arXiv:2602. 13362v2 Announce Type: replace-cross Abstract: A key challenge in probabilistic regression is ensuring that predictive distributions accurately reflect true empirical uncertainty.

By \'Ad\'am Jung, Domokos M. Kelen, Andr\'as A. Bencz\'ur

rag benchmarks safety

arXiv Machine Learning

Jul 31

Uncertainty quantification for trustworthy deep learning: Methods and measures

arXiv:2607. 28248v1 Announce Type: cross Abstract: The deployment of deep neural networks in safety-critical domains demands reliable estimates of predictive confidence, yet conventional architectures lack principled uncertainty quantification.

By H. Martin Gillis, Thomas Trappenberg

llms safety

One email a morning, machine-written

Related stories

A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk

Quantifying Aleatoric Uncertainty of In-Context Learning for Robust Measure of LLM Prediction Confidence

Evaluating Epistemic Uncertainty: Beyond OOD Detection and Active Learning

Variance-Gated Ensembles: An Epistemic-Aware Framework for Uncertainty Estimation

Nonparametric Distribution Regression Re-calibration

Uncertainty quantification for trustworthy deep learning: Methods and measures