arXiv Computer Vision

A Plug-in Interpretation of Conditioning in Score-Based Diffusion Models

arXiv:2608. 19504v1 Announce Type: new Abstract: We propose a conditioning mechanism for diffusion models based on multi-speed joint diffusion of the target and the condition.

Hugging Face Trending Papers
5d ago

Efficient Covariance-Aware Vicinal Latent Diffusion for Continuous Conditional Image Generation

Efficient Covariance-Aware Vicinal Latent Diffusion (CAViLD) is a latent diffusion framework designed for continuous conditional image generation. It builds a purified, condition-aware latent space using density-adaptive vicinal learning, auxiliary semantic regularization, and NIQE-guided negative data augmentation. CAViLD incorporates an EMA teacher to internalize conditional guidance, enabling single-branch inference, and employs covariance-aware progressive distillation to reduce sampling steps to four NFEs, achieving a balance between fidelity, condition consistency, and efficiency on datasets such as RC-49, UTKFace, and Steering Angle.

arXiv Computer Vision
Oct 2

Principled Design of Diffusion-based Optimizers for Inverse Problems

Score‑based diffusion models excel at inverse problems but suffer from slow inference and task‑specific hyperparameter tuning. This paper introduces principled reparameterizations that create invariances, enabling the reuse of the same hyperparameters across different tasks. Building on the RED‑diff framework, the authors present OptDiff, a streamlined pipeline that integrates convex optimization to accelerate inference, achieving notable speedups and higher image quality in reconstruction, deblurring, and super‑resolution experiments.

By Julio Oscanoa, Irmak Sivgin, Cagan Alkan, Daniel Ennis, John Pauly, Mert Pilanci, Shreyas Vasanawala
Hugging Face Trending Papers
Aug 6

LC-GRPO: Bridging Train-Inference Gap for Flow-Based GRPO with Langevin Correction

Flow-based generative models are typically sampled by solving a deterministic ordinary differential equation (ODE), whereas online reinforcement learning requires stochastic rollouts for policy exploration and optimization. Existing GRPO methods for flow models therefore replace the inference-time ODE with a stochastic differential equation (SDE) during training.

arXiv Machine Learning
Aug 31

Improved off-policy training of diffusion samplers

The paper investigates training diffusion models to sample from distributions defined by unnormalized densities or energy functions. It benchmarks various diffusion-structured inference techniques, including simulation-based variational methods and off-policy approaches such as continuous generative flow networks, highlighting their relative strengths and challenging some prior claims. Additionally, the authors introduce a new exploration strategy for off-policy methods that employs local search in the target space with a replay buffer, demonstrating improved sample quality across multiple target distributions.

By Marcin Sendera, Minsu Kim, Sarthak Mittal, Pablo Lemos, Luca Scimeca, Jarrid Rector-Brooks, Alexandre Adam, Yoshua Bengio, Esmeralda S. Whitammer
arXiv Machine Learning
Oct 12

Opening the Black Box of Classifier-Free Guidance via Information Bottleneck

The paper investigates when to activate classifier‑free guidance (CFG) in diffusion models by treating the diffusion trajectory as a time‑dependent information bottleneck. It shows that the usefulness of conditional information increases after a critical stage defined by a Fisher‑information balance, and proposes a training‑free dynamic CFG strategy that activates guidance based on a stochastic process of score statistics. Experiments across various architectures and tasks confirm that this adaptive rule improves effectiveness, robustness, and general applicability while offering a principled explanation for dynamic guidance.

By Jiayang Gao, Tianyi Zheng, Jiayang Zou, Fengxiang Yang, Luyao Fan, Lv Tang, Bo Li, Jia Wang
arXiv Machine Learning
Oct 16

Two-Stage Score Estimation for Group-Specific Diffusion Models

The paper introduces a statistical framework for diffusion transfer in generative modeling across related distributions. It analyzes a shared pooled score and a target‑specific offset, deriving convergence rates that separate the learning costs of these components. The authors prove that under certain regularity assumptions the offset remains bounded and jointly regular as diffusion time approaches zero, enabling polynomially vanishing lower time cutoffs and total‑variation guarantees for diffusion models as density estimators, with synthetic simulations and image benchmarks illustrating the approach.

By Huitao Yang, Oscar Hernan Madrid Padilla