The paper introduces a scalable method for uncertainty quantification in neural networks by applying a low‑rank generalized Laplace approximation within a data‑informed active subspace. It constructs a local Gaussian posterior around pretrained weights, calibrates the prior variance via empirical Bayes, and compares two posterior scalings: standard Bayesian and mean‑loss scaling. The study finds that mean‑loss scaling yields a more stable, lower‑dimensional subspace and produces calibrated, coherent predictive confidence intervals, whereas standard scaling can cause posterior variance contraction and degrade predictive coherence.
By Wouter N. Edeling, Peter V. Coveney
arXiv:2608.29349v1 Announce Type: new
Abstract: Gaussian process (GP) regression with a single global GP (GP-glo) incurs cubic computational cost, limiting scalability to large datasets. Product-of-e...
By Yean Hoon Ong, Paolo Barucca, Wei Pan, Jun Wang
arXiv:2606. 27269v1 Announce Type: cross Abstract: Reliably quantifying predictive uncertainty is difficult for complex, high-dimensional, or misspecified models.
By Graham Gibson, John Tipton, Kellin Rumsey, Natalie Klein
arXiv:2606. 13818v1 Announce Type: new Abstract: This thesis investigates how Bayesian principles can deepen our understanding of modern deep learning systems.
By Luis A. Ortega
arXiv:2610.19074v1 Announce Type: new
Abstract: Reliable uncertainty quantification remains an important challenge in AI. Hierarchical Bayesian methods provide a principled framework for this by repr...
By Neil K. Chada, Simon Cotter, Kody J. H. Law, Xinzhu Liang
arXiv:2606. 23838v1 Announce Type: new Abstract: When two or more parameters or labels produce similar data, they are degenerate, or hard to distinguish.
By T. Lucas Makinen, Deaglan J. Bartlett, Niall Jeffrey, Benjamin D. Wandelt
arXiv:2602. 00387v4 Announce Type: replace-cross Abstract: Bayesian neural networks promise calibrated uncertainty but require $O(mn)$ parameters for standard mean-field Gaussian posteriors.
By Mame Diarra Toure, David A. Stephens
arXiv:2407. 12288v5 Announce Type: replace-cross Abstract: The progress of machine learning over the past decade is undeniable.
By Hong Jun Jeon, Benjamin Van Roy
arXiv:2601. 07944v2 Announce Type: replace-cross Abstract: Since the turn of the century, approximate Bayesian inference has steadily evolved as new computational techniques have been incorporated to handle increasingly complex, large-scale predictive problems.
By Roy Shivam Ram Shreshtth, Arnab Hazra, Gourab Mukherjee
arXiv:2608. 05995v1 Announce Type: new Abstract: Reliable uncertainty estimates are critical in safety-sensitive applications, where understanding the sources of predictive uncertainty is essential.
By Frieder Wizgall, Georg Tirpitz, Moritz Seiler, Kerstin Ritter, B\'alint Mucs\'anyi
arXiv:2605. 00600v2 Announce Type: replace-cross Abstract: Deep neural networks achieve impressive results across diverse applications, yet their overconfidence on unseen inputs necessitates reliable epistemic uncertainty modeling.
By Yao Ni, Jeremie Houssineau, Yew Soon Ong, Piotr Koniusz
arXiv:2607. 06252v1 Announce Type: cross Abstract: Many problems in science and engineering are difficult to model accurately, either due to unknown physical mechanisms, poorly quantified measurement uncertainty, or prohibitive computational costs of high-fidelity simulations.
By Fabian Schneider, Tapio Helin, Leila Taghizadeh