arXiv Machine Learning

A Convex Approximation Framework for Neural Likelihood-Based Bayesian Inverse Problems

arXiv:2607. 06252v1 Announce Type: cross Abstract: Many problems in science and engineering are difficult to model accurately, either due to unknown physical mechanisms, poorly quantified measurement uncertainty, or prohibitive computational costs of high-fidelity simulations.

arXiv AI
Jul 20

Energy-based Transport for Amortized Bayesian Inference

arXiv:2605. 15407v3 Announce Type: replace-cross Abstract: We consider amortized Bayesian inference for nonlinear inverse problems using only samples from the joint distribution of parameters and observations, including problems with unknown functions in a Banach space.

By Ricardo Baptista, Hojjat Kaveh, Andrew M. Stuart
arXiv Machine Learning
Sep 24

Inverse Problems Conditioned on Observation Ensembles: Applications and Methods

The paper introduces the Ensemble-conditioned Inverse Problem (EIP), a multivariate statistical framework for inferring an ensemble that follows the pushforward of a prior through a forward process. It applies to fields such as high‑energy physics, full waveform inversion, and inverse imaging, and proposes non‑iterative inference‑time methods using ensemble inverse generative models that avoid explicit forward model use during inference. The authors demonstrate the approach on synthetic and real datasets and provide code for replication.

By Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron
arXiv Statistics ML
Sep 14

PDE-constrained inverse problems at the $\sqrt{n}$ rate via debiased physics-informed neural networks

The paper introduces a two‑step debiased estimation method for PDE‑constrained inverse problems where the PDE solution is approximated by Physics‑Informed Neural Networks (PINNs). By combining neural‑network‑based nonparametric estimation with an influence‑function bias correction, the authors achieve a √{n}-consistent, asymptotically normal estimator without undersmoothing the neural network. The approach is extended to Bayesian inference, yielding a posterior that contracts at the √{n}-rate with asymptotic covariance matching the frequentist estimator, and the analysis also provides near‑minimax rates for estimating nonparametric regression functions and their derivatives in Sobolev spaces.

By Yves Atchade, Debarghya Mukherjee
arXiv AI
Jun 16

Variance Reduction for Non-Log-Concave Sampling with Applications to Inverse Problems

arXiv:2606. 16257v1 Announce Type: cross Abstract: Sampling from high-dimensional, non-log-concave distributions with unnormalized densities is a fundamental challenge in machine learning, particularly when the exact gradient of the potential is unavailable and must be approximated via stochastic gradients that exhibit high variance under a fixed budget of gradient computations per iteration.

By M. Berk Sahin, Ahmet Ege Tanriverdi, Behzad Sharif, Abolfazl Hashemi
arXiv Machine Learning
Sep 18

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

PosteriorBench is a new benchmark that evaluates how well generative inverse solvers recover full posterior distributions rather than just a single reconstruction. It tests four physics-based inverse problems—Darcy flow inversion, Poisson source recovery, carbon capture and storage, and light transport material inference—using high-fidelity reference posteriors generated by rejection sampling and MCMC. The benchmark employs five metrics (posterior-mean error, posterior-standard-deviation error, maximum mean discrepancy, sliced Wasserstein distance, and radially averaged power-spectrum error) to assess pointwise accuracy, uncertainty, distributional alignment, and global frequency fidelity, revealing significant distribution-matching gaps in current solvers and highlighting the importance of neural operators, guidance weights, and generation noise for posterior-variance calibration.

By Jiachen Yao, Zi-Siang Hsu, Xi Deng, Aditi Gupta, Xin Ju, Sally M Benson, Gege Wen, Anima Anandkumar
arXiv Machine Learning
Aug 14

Functional-prior-based approaches to Bayesian PDE-constrained inversion using physics-informed neural networks

arXiv:2605. 07060v3 Announce Type: replace-cross Abstract: Physics-informed neural networks (PINNs) provide a mesh-free framework for solving PDE-constrained inverse problems, but their extension to Bayesian inversion still faces a fundamental difficulty: prior distributions are typically defined in the weight space of neural networks, whereas physically meaningful prior assumptions are more naturally expressed in function space.

By Ryoichiro Agata, Tomohisa Okazaki