arXiv Machine Learning

Accelerated Execution of Bayesian Neural Networks using a Single Probabilistic Forward Pass and Code Generation

The paper presents a pipeline for training, compiling, and deploying Bayesian neural networks (BNNs) that use a single probabilistic forward pass (PFP) instead of multiple stochastic samples. By assuming Gaussian-distributed weights and activations, PFP enables fully analytic uncertainty propagation, allowing a single deterministic forward pass to replace sampling. Using the TVM compiler and a library of Gaussian-propagating operators, the authors achieve up to 4200× speedups on small mini-batches while maintaining accuracy, uncertainty estimation, and out-of-domain detection comparable to traditional stochastic variational inference (SVI).

arXiv Machine Learning
Aug 4

Constrained Co-Design for Photonic Bayesian Neural Networks

arXiv:2608. 02229v1 Announce Type: new Abstract: Classical neural networks frequently produce overconfident predictions on ambiguous or out-of-distribution (OOD) data, a liability that grows with each AI system deployed in safety-critical real-world scenarios.

By Hendrik Borras, Xiao Wang, Bernhard Klein, Robin Janssen, Frank Br\"uckerhoff-Pl\"uckelmann, Wolfram Pernice, Holger Fr\"oning
arXiv AI
Jul 7

Last Layer Hamiltonian Monte Carlo

arXiv:2507. 08905v2 Announce Type: replace-cross Abstract: We explore the use of Hamiltonian Monte Carlo (HMC) sampling as a probabilistic last layer approach for deep neural networks (DNNs).

By Koen Vellenga, H. Joe Steinhauer, G\"oran Falkman, Jonas Andersson, Anders Sj\"ogren