arXiv Machine Learning

Restrained Diffusion Bridges: Targeted Denoiser Training and Refinement

arXiv Machine Learning
Aug 31

Improved off-policy training of diffusion samplers

The paper investigates training diffusion models to sample from distributions defined by unnormalized densities or energy functions. It benchmarks various diffusion-structured inference techniques, including simulation-based variational methods and off-policy approaches such as continuous generative flow networks, highlighting their relative strengths and challenging some prior claims. Additionally, the authors introduce a new exploration strategy for off-policy methods that employs local search in the target space with a replay buffer, demonstrating improved sample quality across multiple target distributions.

By Marcin Sendera, Minsu Kim, Sarthak Mittal, Pablo Lemos, Luca Scimeca, Jarrid Rector-Brooks, Alexandre Adam, Yoshua Bengio, Esmeralda S. Whitammer
arXiv Machine Learning
Oct 12

Bridge Matching Sampler: Scalable Sampling via Generalized Fixed-Point Diffusion Matching

Bridge Matching Sampler (BMS) is a new diffusion-based sampling method that generalizes least-squares matching objectives into fixed-point iterations using Nelson's relation. It learns a stochastic transport map between any prior and target distribution with a single, scalable, and stable objective, and a damped variant adds regularization to reduce mode collapse. Experiments show BMS can sample at unprecedented scales while preserving mode diversity, achieving state‑of‑the‑art results on complex synthetic densities and high‑dimensional molecular benchmarks.

By Denis Blessing, Lorenz Richter, Julius Berner, Egor Malitskiy, Gerhard Neumann
arXiv Machine Learning
Oct 12

Spanning Diffusion and Flow-based Posterior Sampling via Exact Gaussian Conditioning

The paper introduces β‑Flow, a versatile plug‑and‑play posterior sampling framework that unifies flow‑matching, diffusion, and decorrelated priors through a correlation parameter β and a confidence parameter κ. Each iteration requires only a single denoising network forward pass followed by an exact Gaussian conditioning step, implemented as a Kalman update independent of network gradients. The authors demonstrate that many existing guided samplers are special cases of β‑Flow, and show state‑of‑the‑art performance on seven inverse problems across four datasets, with the ability to tune prior strength based on data informativeness.

By Teo Deveney, Lea Bogensperger, Hok Shing Wong
arXiv Computer Vision
Sep 28

PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution

arXiv:2609.30988v1 Announce Type: new Abstract: Real-world image super-resolution (SR) requires recovering perceptually realistic high-resolution images from complex low-resolution observations while...

By Xin Di, Mingyu Shi, Yuanfei Bao, Long Peng, Yue Zhao, Jiaming Guo, Renjing Pei, Xueyang Fu, Yang Cao, Zheng-Jun Zha
arXiv AI
Oct 15

Correction Training for Diffusion Models

arXiv:2610.14136v2 Announce Type: new Abstract: Iterative sampling in diffusion models can lead to error accumulation due to exposure bias. The denoiser is trained on real images interpolated with no...

By Donghoon Ahn, Runqian Wang, Alexei A. Efros, Taesung Park, Yash Belhe