arXiv Statistics ML

Amortized quadrature for posterior expectations in inverse problems

arXiv Machine Learning
Jun 16

Amortized mean-shift interacting particles

arXiv:2606. 15871v1 Announce Type: cross Abstract: Bayesian inference for inverse problems is run to evaluate integrals -- posterior expectations, tail probabilities, and risks -- across a stream of observations.

By Ali Siahkoohi
arXiv AI
Jul 20

Energy-based Transport for Amortized Bayesian Inference

arXiv:2605. 15407v3 Announce Type: replace-cross Abstract: We consider amortized Bayesian inference for nonlinear inverse problems using only samples from the joint distribution of parameters and observations, including problems with unknown functions in a Banach space.

By Ricardo Baptista, Hojjat Kaveh, Andrew M. Stuart
arXiv Machine Learning
Sep 17

Bayesian Quadrature

This survey article reviews Bayesian quadrature, a probabilistic, model‑based method for numerical integration and expectation estimation. It provides a systematic taxonomy of Bayesian quadrature techniques across modelling, inference, and sampling, presents theoretical guarantees, and includes a controlled numerical study illustrating the impact of different methodological choices. The paper also discusses practical challenges, limitations, and offers an extensive bibliography covering machine learning, statistics, mathematics, and engineering applications.

By Maren Mahsereci, Toni Karvonen
arXiv Statistics ML
Aug 26

A Non-asymptotic Analysis for Learning and Applying a Preconditioner in MCMC

The paper presents a non‑asymptotic analysis of Markov chain Monte Carlo (MCMC) algorithms that learn and apply a preconditioner based on either the target covariance or the expected Hessian of the target potential. It compares the finite‑time computational costs of these preconditioned schemes with unpreconditioned counterparts, providing guarantees for algorithms such as the Unadjusted Langevin Algorithm (ULA) and the proximal sampler. The analysis relies on a contraction assumption in the Wasserstein‑2 distance to formalize approximate independence and bridge modern MCMC theory with classical effective sample size heuristics.

By Max Hird, Florian Maire, Jeffrey Negrea
arXiv Machine Learning
Jul 14

Hierarchical Bayesian Quadrature

arXiv:2607. 10793v1 Announce Type: new Abstract: Numerical integration is a cornerstone of various scientific computing applications, such as engineering simulations and model evidence computations in probabilistic machine learning.

By Tim Weiland, Toni Karvonen, Philipp Hennig
arXiv Machine Learning
Sep 3

Source Distribution Estimation by Posterior Averaging

The paper introduces a new approach to source distribution estimation (SDE) in simulation-based science, addressing limitations of existing methods that rely on a fixed surrogate likelihood. By employing an expectation‑maximization framework, the authors iteratively train an amortized posterior on fresh simulations (E‑step) and refit the source distribution to the posterior’s average (M‑step). Two parameterizations are explored: separate source and posterior flows, and a single shared conditional flow, with experiments on three benchmark tasks showing improved performance over fixed surrogate and iterated baseline methods, notably achieving higher data‑space C2ST scores on the Lotka–Volterra benchmark.

By Trung-Dung Hoang, Lisa M. Koch
arXiv Machine Learning
Aug 27

Continually learning neural-operator surrogate for three-dimensional airborne electromagnetic Bayesian inversion

The paper presents a continually learning neural‑operator surrogate for the three‑dimensional forward operator used in time‑domain airborne electromagnetic (AEM) Bayesian inversion. By training on successive geological priors and employing an ensemble‑disagreement validity check, the surrogate replaces the expensive forward solver, enabling the Markov chain Monte Carlo sampler to reproduce the full‑solver posterior with credible intervals within 2.6 % of the truth. Applied to the 2013 Capricorn TEMPEST survey, the surrogate inverts over two million soundings in seconds, making uncertainty‑quantified conductivity imaging at survey scale feasible for near real‑time mineral‑systems targeting.

By Jaehong Chung, Andrew Lockwood, Jef Caers