arXiv Machine Learning By Huitao Yang, Oscar Hernan Madrid Padilla

Two-Stage Score Estimation for Group-Specific Diffusion Models

Read the original on arXiv Machine Learning →

The paper introduces a statistical framework for diffusion transfer in generative modeling across related distributions. It analyzes a shared pooled score and a target‑specific offset, deriving convergence rates that separate the learning costs of these components. The authors prove that under certain regularity assumptions the offset remains bounded and jointly regular as diffusion time approaches zero, enabling polynomially vanishing lower time cutoffs and total‑variation guarantees for diffusion models as density estimators, with synthetic simulations and image benchmarks illustrating the approach.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 24

Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate

arXiv:2606. 23920v1 Announce Type: cross Abstract: The task of compositional generation involves using a conditional generative model, trained only on a subset of the possible conditions, to produce samples from compositionally-defined target distributions such as a geometric combination of the source distributions.

By Duncan Soiffer, Chandler Squires, Yuan Guan, Jason Hartford, Pradeep Ravikumar
arXiv Machine Learning
Sep 2

Control Variate Score Matching for Diffusion Models

arXiv:2512.20003v2 Announce Type: replace Abstract: Sampling from unnormalized probability densities is a pervasive challenge across the computational and physical sciences. Diffusion models provide...

By Khaled Kahouli, Romuald Elie, Klaus-Robert M\"uller, Quentin Berthet, Oliver T. Unke, Arnaud Doucet
arXiv Machine Learning
Aug 31

Improved off-policy training of diffusion samplers

The paper investigates training diffusion models to sample from distributions defined by unnormalized densities or energy functions. It benchmarks various diffusion-structured inference techniques, including simulation-based variational methods and off-policy approaches such as continuous generative flow networks, highlighting their relative strengths and challenging some prior claims. Additionally, the authors introduce a new exploration strategy for off-policy methods that employs local search in the target space with a replay buffer, demonstrating improved sample quality across multiple target distributions.

By Marcin Sendera, Minsu Kim, Sarthak Mittal, Pablo Lemos, Luca Scimeca, Jarrid Rector-Brooks, Alexandre Adam, Yoshua Bengio, Esmeralda S. Whitammer