arXiv Machine Learning

Multi-Dataset Inverse Problem Solving with Distributed Generative AI

The paper introduces a generalized framework for solving inverse problems across multiple heterogeneous datasets using distributed generative AI. It extends the SAGIPS framework to handle non‑identically distributed data, employing separate forward operators and discriminators for each dataset while guiding a shared generator toward global parameter consistency. Validation on a multi‑detector scattering experiment demonstrates robustness to varying data fidelities and scalability on multi‑GPU systems.

arXiv Machine Learning
Sep 24

Inverse Problems Conditioned on Observation Ensembles: Applications and Methods

The paper introduces the Ensemble-conditioned Inverse Problem (EIP), a multivariate statistical framework for inferring an ensemble that follows the pushforward of a prior through a forward process. It applies to fields such as high‑energy physics, full waveform inversion, and inverse imaging, and proposes non‑iterative inference‑time methods using ensemble inverse generative models that avoid explicit forward model use during inference. The authors demonstrate the approach on synthetic and real datasets and provide code for replication.

By Zhengyan Huan, Camila Pazos, Martin Klassen, Vincent Croft, Pierre-Hugues Beauchemin, Shuchin Aeron
arXiv Machine Learning
Sep 18

PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

PosteriorBench is a new benchmark that evaluates how well generative inverse solvers recover full posterior distributions rather than just a single reconstruction. It tests four physics-based inverse problems—Darcy flow inversion, Poisson source recovery, carbon capture and storage, and light transport material inference—using high-fidelity reference posteriors generated by rejection sampling and MCMC. The benchmark employs five metrics (posterior-mean error, posterior-standard-deviation error, maximum mean discrepancy, sliced Wasserstein distance, and radially averaged power-spectrum error) to assess pointwise accuracy, uncertainty, distributional alignment, and global frequency fidelity, revealing significant distribution-matching gaps in current solvers and highlighting the importance of neural operators, guidance weights, and generation noise for posterior-variance calibration.

By Jiachen Yao, Zi-Siang Hsu, Xi Deng, Aditi Gupta, Xin Ju, Sally M Benson, Gege Wen, Anima Anandkumar
arXiv AI
Oct 28

BoLT: A Benchmark to Democratize Black-box Optimization Research for Expensive LLM Tasks

BoLT is a new benchmark designed to make black-box optimization research for large language model (LLM) tasks more accessible. It presents a suite of realistic LLM optimization problems—covering multi‑fidelity, multi‑objective, heteroscedastic noise, and high‑dimensional search spaces—grounded in thousands of real experiments and represented by lightweight surrogate models. The authors evaluate a wide range of Bayesian and other black‑box optimization methods on BoLT, finding that some BO techniques consistently outperform others and revealing gaps in current methods for LLM optimization.

By Ruth Wan Theng Chew, Zhiliang Chen, Apivich Hemachandra, Bryan Kian Hsiang Low
arXiv Machine Learning
2d ago

AdjointFlow: Accelerating Scientific Inverse Problems with Physics-Based Transport

AdjointFlow is a new framework that accelerates scientific inverse problems by embedding known physics directly into a generative transport model. It uses stochastic interpolants, an adjoint-based initialization, and a modified transport velocity to handle concentrated target distributions, enabling accurate reconstructions at much lower computational cost than traditional generative or plug‑and‑play methods. Experiments on inverse scattering, seismic imaging, and black hole imaging demonstrate that AdjointFlow outperforms conditional diffusion models and can be up to five orders of magnitude faster than plug‑and‑play inference while still allowing optional refinement for improved data consistency.

By Ethan Hanold, Nicholas M. Boffi, Qin Li, Leonardo Zepeda-N\'u\~nez