The paper develops a statistical framework showing that empirical score matching can achieve minimax optimal performance for diffusion generative models when data lie on a low‑dimensional manifold. It establishes convergence rates for empirical risk minimization over constrained Sobolev classes and demonstrates that the resulting score estimators yield minimax optimal Wasserstein‑1 rates for the generated distribution, up to logarithmic factors. The analysis reveals that the statistical rates depend on the intrinsic dimension of the data manifold rather than its ambient dimension, providing conditions under which score‑based generative modeling generalizes rather than overfits.
arXiv:2602.19600v2 Announce Type: replace Abstract: Many high-dimensional datasets concentrate near a low-dimensional structure embedded in the ambient space. Generative models for such data must con...
arXiv:2607. 04442v1 Announce Type: cross Abstract: Diffusion models (DMs) are a state-of-the-art generative method to approximately sample from an unknown distribution.
arXiv:2409. 18804v3 Announce Type: replace-cross Abstract: Denoising Diffusion Probabilistic Models (DDPM) are powerful state-of-the-art methods used to generate synthetic data from high-dimensional data distributions and are widely used for image, audio, and video generation as well as many more applications in science and beyond.
arXiv:2606. 16610v1 Announce Type: cross Abstract: Diffusion Flow Matching (DFM) has recently emerged as a versatile framework for generative modeling, yet its theoretical convergence properties remain only partially understood.
The paper introduces a new method for perturbing data distributions in a way that respects equality constraints, allowing generative models to better handle constrained data. By adjusting the distribution while preserving the manifold geometry, the approach ensures support matches the ambient space dimension. Experiments with diffusion models and normalizing flows demonstrate improved data recovery and stable sampling across several tasks.
arXiv:2609.27546v1 Announce Type: cross Abstract: Score-based diffusion models are increasingly considered in settings where the underlying data distribution may differ from the training distribution...
arXiv:2501. 12982v3 Announce Type: replace-cross Abstract: This paper investigates how diffusion generative models leverage (unknown) low-dimensional structure to accelerate sampling.
arXiv:2509. 24710v2 Announce Type: replace-cross Abstract: Score-based diffusion models are a highly effective method for generating samples from a distribution of images.
The paper investigates diffusion models trained in a lazy high‑dimensional regime, extending benign overfitting theory to generative settings. By analyzing denoising score matching in a vector‑valued RKHS with an inner‑product kernel, the authors derive exact risk trajectories under gradient flow when the number of samples scales proportionally with dimensionality. These trajectories reveal three distinct phases—spectral generalization, noise‑dominated interpolation, and empirical Bayes memorization—whose interplay shapes the distribution of generated samples.
arXiv:2606. 19894v1 Announce Type: new Abstract: The remarkable success of score-based diffusion models has spurred significant efforts to establish their theoretical foundations.
The paper introduces a statistical framework for diffusion transfer in generative modeling across related distributions. It analyzes a shared pooled score and a target‑specific offset, deriving convergence rates that separate the learning costs of these components. The authors prove that under certain regularity assumptions the offset remains bounded and jointly regular as diffusion time approaches zero, enabling polynomially vanishing lower time cutoffs and total‑variation guarantees for diffusion models as density estimators, with synthetic simulations and image benchmarks illustrating the approach.
arXiv:2608. 04827v1 Announce Type: cross Abstract: We introduce the Intrinsic Hybrid Latent Diffusion Model (ILDM), a generative framework that integrates probabilistic dimensionality reduction with geometry-aware diffusion on unknown manifolds.