arXiv Machine Learning

A Gaussian Perspective for Distributional Discrepancy in Generative Diffusion Models

arXiv:2601. 13602v3 Announce Type: replace-cross Abstract: This paper introduces an analytical approach to quantifying and optimizing the distributional discrepancy in generative diffusion models.

arXiv Machine Learning
Sep 3

Generative Diffusion Surrogates with Analytical Variance Schedule

The paper introduces a method for creating generative diffusion surrogates that use an analytically derived variance schedule based on the time derivative of known variance from macroscopic theory or empirical scaling. By enforcing this variance path, the model can capture non‑Gaussian structure in transport systems without requiring intermediate‑time physical data. The approach is validated on ballistic‑to‑diffusive transport in turbulent plasmas, accurately reproducing test‑particle distributions, laboratory‑measured variance, and simulated kurtosis evolution.

By Patrick Reichherzer, Gianluca Gregori, David N. Hosking, Subir Sarkar
arXiv AI
Jun 24

Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate

arXiv:2606. 23920v1 Announce Type: cross Abstract: The task of compositional generation involves using a conditional generative model, trained only on a subset of the possible conditions, to produce samples from compositionally-defined target distributions such as a geometric combination of the source distributions.

By Duncan Soiffer, Chandler Squires, Yuan Guan, Jason Hartford, Pradeep Ravikumar
arXiv Machine Learning
Jul 17

The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysis

arXiv:2506. 11378v3 Announce Type: replace Abstract: Sampling in score-based diffusion models can be performed by solving either a reverse-time stochastic differential equation (SDE) parameterized by an arbitrary stochasticity function or a probability flow ODE, corresponding to setting this stochasticity function to zero.

By Bernardo P. Schaeffer, Ricardo M. S. Rosa, Glauco Valle
arXiv Machine Learning
Jul 20

Diffusion models recover accurate mixture weights despite score function insensitivity

arXiv:2607. 15485v1 Announce Type: new Abstract: Score-based generative models exhibit a puzzling behavior: they often appear to cover all modes of a target multimodal distribution and yet may fail to learn the correct relative mode amplitudes, which can be interpreted as mixture weights.

By Andrew Dennehy, Ramchandran Muthukumar, Rebecca Willett, Nisha Chandramoorthy
arXiv AI
Aug 28

The Principles of Diffusion Models

The book "The Principles of Diffusion Models" outlines the foundational concepts behind diffusion models, tracing their evolution from a forward process that corrupts data into noise to a reverse process that reconstructs data. It presents three complementary perspectives—variational, score-based, and flow-based—each describing how a time-dependent velocity field transports a simple prior to the data distribution. The text also covers practical guidance for controllable generation, efficient solvers, and diffusion-inspired flow-map models, providing a mathematically grounded framework for readers with basic deep‑learning knowledge.

By Chieh-Hsin Lai, Yang Song, Dongjun Kim, Yuki Mitsufuji, Stefano Ermon