arXiv Machine Learning

Kinetic Langevin Meets Split Gibbs: Accelerated Posterior Sampling for Imaging Inverse Problems with Diffusion Priors

The paper introduces RED-KLwSGS, a new posterior sampling method for Bayesian imaging inverse problems that combines exact Gaussian updates for the data variable with underdamped (kinetic) Langevin diffusion for the auxiliary variable, driven by a one‑shot denoising score. It achieves the same per‑iteration cost as existing Langevin‑within‑SGS samplers while providing non‑asymptotic Wasserstein‑2 convergence guarantees for strongly log‑concave priors. A further variant, Joint-RED-KLwSGS, applies kinetic Langevin diffusion to both variables, and experiments using denoising diffusion probabilistic models on FFHQ and ImageNet demonstrate faster convergence and high‑quality image reconstruction.

arXiv AI
Sep 4

A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors

The paper introduces a Posterior‑Dynamics Framework that leverages pretrained diffusion models as multiscale priors for linear imaging inverse problems such as deblurring, super‑resolution, and inpainting. By constructing a surrogate likelihood centered on the clean image and incorporating diffusion uncertainty, the authors derive continuous posterior dynamics and a tunable Langevin component for adaptive exploration. They prove theoretical guarantees (endpoint consistency, finite‑horizon tracking, weak accuracy) and present the PD‑IMEX sampler, which achieves high‑quality reconstructions with only 100 score evaluations and controllable fidelity‑diversity trade‑offs.

By Zhaoqiang Liu, Tongyao Pang, Ruibing Wang, Yang Zheng
arXiv Computer Vision
Sep 18

FlowSGS: Improving Flow Matching Priors for Inverse Imaging with Stochastic Interpolants

FlowSGS introduces a flow-based posterior sampling method that combines Split Gibbs Sampling (SGS) with Langevin dynamics for the likelihood step and Stochastic Interpolants (SI) for the prior step. By integrating a pretrained flow model into the prior step via SI's reverse-time SDE and a novel timestep correction, FlowSGS reduces the number of network evaluations compared to plug‑and‑play diffusion samplers. Experiments demonstrate state‑of‑the‑art performance on various inverse problems, including the first flow‑based solution to a nonlinear inverse problem (Fourier phase retrieval).

By Tianao Li, Xinhui Qian, Emma Alexander
arXiv Machine Learning
Aug 19

Picard Proximal Monte Carlo for Parallel Bayesian Imaging with Score-Based Generative Priors

The paper introduces PiX-MC, a time‑parallel posterior sampling framework that combines proximal Langevin dynamics with Picard iteration for Bayesian imaging inverse problems. By leveraging efficient proximal operators for many imaging likelihoods and exploiting parallelism across discretization nodes, PiX-MC supports multi‑GPU implementation and includes multi‑block and annealed variants to enhance scalability. Experiments on various imaging tasks, including a large‑scale sparse‑view CT problem, show that PiX‑MC can reduce runtime by up to 50× while maintaining reconstruction quality.

By Deliang Wei, Evan Bell, Wenhan Guo, Yifan Chen, Yu Sun
arXiv Machine Learning
4d ago

Noise, Denoise, Correct: MCMC Posterior Sampling with Diffusion Priors in Three Steps

The paper introduces Diffusion Waltz, an MCMC algorithm that uses SDEdit-style noising and denoising as a proposal and corrects it with Metropolis-Hastings to achieve exact posterior sampling without evaluating the prior. It also incorporates observations into the proposal via a gradient‑free ensemble Kalman update while maintaining exactness. In experiments on a non‑differentiable Navier‑Stokes initial‑condition recovery problem, Diffusion Waltz outperforms existing baselines across various noise and nonlinearity regimes.

By So Takao, Gregory David Bellchambers, Luke Ye, Sanmitra Ghosh, Michalis Michaelides
arXiv Statistics ML
Sep 28

Learning to Replace MCMC in Split-Gibbs Diffusion Posterior Sampling via Deep Unfolding

The paper introduces a learning-based approach to replace the MCMC step in split-Gibbs diffusion posterior sampling. By reformulating both Gibbs updates as Gaussian denoising problems, the method uses ODE diffusion for the prior step with a pretrained denoiser and a lightweight deep-unfolded network for the likelihood step. Experiments on nonlinear phase retrieval show that this alternative reduces likelihood-update cost while maintaining effectiveness compared to MCMC-based split Gibbs.

By Yi Zhang, Rui Guo, Mengchu Xu, Zhaofeng Liu, Yonina C. Eldar
arXiv Computer Vision
Oct 2

Principled Design of Diffusion-based Optimizers for Inverse Problems

Score‑based diffusion models excel at inverse problems but suffer from slow inference and task‑specific hyperparameter tuning. This paper introduces principled reparameterizations that create invariances, enabling the reuse of the same hyperparameters across different tasks. Building on the RED‑diff framework, the authors present OptDiff, a streamlined pipeline that integrates convex optimization to accelerate inference, achieving notable speedups and higher image quality in reconstruction, deblurring, and super‑resolution experiments.

By Julio Oscanoa, Irmak Sivgin, Cagan Alkan, Daniel Ennis, John Pauly, Mert Pilanci, Shreyas Vasanawala
arXiv AI
Oct 5

Consecutive Posterior Fusion for Diffusive Recovery of Unobservable Image Structures

The paper introduces Consecutive Posterior Fusion Denoising Diffusion Null‑Space Models (CPF‑DDNM), an inference‑time method that fuses successive measurement‑aware estimates to better recover unobservable image structures in severely ill‑posed imaging inverse problems. CPF‑DDNM builds on DDNM’s range/null‑space decomposition, preserving measurement‑determined components while refining prior‑driven null‑space estimates. Experiments on sparse‑view CT, low‑dose CT, and medical image super‑resolution demonstrate consistent improvements over DDNM and competitive performance against other diffusion‑based inverse solvers.

By Elena Morotti, Davide Evangelista, Elena Loli Piccolomini