arXiv Machine Learning

Diffusion models recover accurate mixture weights despite score function insensitivity

arXiv:2607. 15485v1 Announce Type: new Abstract: Score-based generative models exhibit a puzzling behavior: they often appear to cover all modes of a target multimodal distribution and yet may fail to learn the correct relative mode amplitudes, which can be interpreted as mixture weights.

arXiv Machine Learning
Sep 2

Control Variate Score Matching for Diffusion Models

arXiv:2512.20003v2 Announce Type: replace Abstract: Sampling from unnormalized probability densities is a pervasive challenge across the computational and physical sciences. Diffusion models provide...

By Khaled Kahouli, Romuald Elie, Klaus-Robert M\"uller, Quentin Berthet, Oliver T. Unke, Arnaud Doucet
arXiv Machine Learning
Sep 11

Smoothing the Score Function to Enhance Generalization in Diffusion Models

The paper investigates memorization in diffusion models, showing that the empirical score function is a weighted sum of Gaussian score functions with sharp softmax weights, causing individual training samples to dominate and lead to sampling collapse. By approximating this function with a neural network, the authors obtain a smoother representation that generalizes better. They introduce two techniques—Noise Unconditioning and Temperature Smoothing—to further reduce single‑sample dominance, and demonstrate improved generalization across multiple datasets while preserving generation quality.

By Xinyu Zhou, Jiawei Zhang, Stephen J. Wright