arXiv Machine Learning

Dual-space posterior sampling for Bayesian inference in constrained inverse problems

arXiv:2603. 00393v2 Announce Type: replace-cross Abstract: Inverse problems constrained by partial differential equations are often ill-conditioned due to noisy, incomplete data or inherent non-uniqueness.

arXiv AI
Jul 20

Energy-based Transport for Amortized Bayesian Inference

arXiv:2605. 15407v3 Announce Type: replace-cross Abstract: We consider amortized Bayesian inference for nonlinear inverse problems using only samples from the joint distribution of parameters and observations, including problems with unknown functions in a Banach space.

By Ricardo Baptista, Hojjat Kaveh, Andrew M. Stuart
Hugging Face Trending Papers
Jun 3

The Right Measure for Physics-Constrained Generation: A Co-Area Correction for Posterior-Consistent PDE Inverse Problems

Generative models -- diffusion and flow matching -- are increasingly used to solve partial differential equation (PDE) inverse problems, enforcing the governing physics as a \emph{hard constraint} (via projection or guidance) and reporting the resulting samples as a Bayesian posterior with calibrated uncertainty. We show that this widely adopted recipe samples the wrong distribution.

arXiv Machine Learning
Jun 4

The Right Measure for Physics-Constrained Generation: A Co-Area Correction for Posterior-Consistent PDE Inverse Problems

arXiv:2606. 04804v1 Announce Type: new Abstract: Generative models -- diffusion and flow matching -- are increasingly used to solve partial differential equation (PDE) inverse problems, enforcing the governing physics as a \emph{hard constraint} (via projection or guidance) and reporting the resulting samples as a Bayesian posterior with calibrated uncertainty.

By Jian Xu, Delu Zeng, John Paisley, Qibin Zhao
arXiv Machine Learning
Sep 18

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

PosteriorBench is a new benchmark that evaluates how well generative inverse solvers recover full posterior distributions rather than just a single reconstruction. It tests four physics-based inverse problems—Darcy flow inversion, Poisson source recovery, carbon capture and storage, and light transport material inference—using high-fidelity reference posteriors generated by rejection sampling and MCMC. The benchmark employs five metrics (posterior-mean error, posterior-standard-deviation error, maximum mean discrepancy, sliced Wasserstein distance, and radially averaged power-spectrum error) to assess pointwise accuracy, uncertainty, distributional alignment, and global frequency fidelity, revealing significant distribution-matching gaps in current solvers and highlighting the importance of neural operators, guidance weights, and generation noise for posterior-variance calibration.

By Jiachen Yao, Zi-Siang Hsu, Xi Deng, Aditi Gupta, Xin Ju, Sally M Benson, Gege Wen, Anima Anandkumar
arXiv Machine Learning
Sep 24

Inverse Problems Conditioned on Observation Ensembles: Applications and Methods

The paper introduces the Ensemble-conditioned Inverse Problem (EIP), a multivariate statistical framework for inferring an ensemble that follows the pushforward of a prior through a forward process. It applies to fields such as high‑energy physics, full waveform inversion, and inverse imaging, and proposes non‑iterative inference‑time methods using ensemble inverse generative models that avoid explicit forward model use during inference. The authors demonstrate the approach on synthetic and real datasets and provide code for replication.

By Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron
arXiv Machine Learning
Sep 1

Sensitivity-Constrained Neural Operators for Data-Efficient Forward and Inverse Modeling of Partial Differential Equation Systems

The paper introduces Sensitivity‑Constrained Neural Operators (SC‑NOs), which augment standard neural operator training with sampled Jacobian supervision from differentiable solvers or discrete adjoints. By matching selected sensitivities during training, SC‑NOs improve forward prediction accuracy and significantly enhance gradient‑based inverse reconstruction for distributed fields. Experiments on advection–diffusion, RANS–Spalart–Allmaras, high‑dimensional gridded inputs, and a shallow‑water tsunami source‑inversion case demonstrate that SC‑NOs achieve a better accuracy–cost trade‑off and enable near‑real‑time wave‑propagation forecasting from sparse observations.

By Abdolmehdi Behroozi, Chaopeng Shen, Daniel Kifer, Kathryn Lawson
arXiv Machine Learning
Aug 14

Functional-prior-based approaches to Bayesian PDE-constrained inversion using physics-informed neural networks

arXiv:2605. 07060v3 Announce Type: replace-cross Abstract: Physics-informed neural networks (PINNs) provide a mesh-free framework for solving PDE-constrained inverse problems, but their extension to Bayesian inversion still faces a fundamental difficulty: prior distributions are typically defined in the weight space of neural networks, whereas physically meaningful prior assumptions are more naturally expressed in function space.

By Ryoichiro Agata, Tomohisa Okazaki
arXiv Machine Learning
Aug 27

Continually learning neural-operator surrogate for three-dimensional airborne electromagnetic Bayesian inversion

The paper presents a continually learning neural‑operator surrogate for the three‑dimensional forward operator used in time‑domain airborne electromagnetic (AEM) Bayesian inversion. By training on successive geological priors and employing an ensemble‑disagreement validity check, the surrogate replaces the expensive forward solver, enabling the Markov chain Monte Carlo sampler to reproduce the full‑solver posterior with credible intervals within 2.6 % of the truth. Applied to the 2013 Capricorn TEMPEST survey, the surrogate inverts over two million soundings in seconds, making uncertainty‑quantified conductivity imaging at survey scale feasible for near real‑time mineral‑systems targeting.

By Jaehong Chung, Andrew Lockwood, Jef Caers