arXiv Machine Learning

How Many Directions Must a Truncated Diffusion Sampler Retain? Matching Bounds Under Power-Law Spectra

The paper investigates how many spectral directions a truncated diffusion sampler must retain when data exhibit power‑law covariance spectra. For Gaussian data compared to a smoothed target, it establishes matching upper and lower bounds on the necessary number of retained directions, assuming a sufficiently large ambient dimension. The analysis shows that truncation error depends on the combined Wiener gains of omitted directions, meaning that even weak individual directions can collectively contribute significant error, and it provides practical guidelines for selecting the retained subspace and diffusion noise level.

arXiv Machine Learning
Oct 8

Lower Bounds for Parallel Diffusion Sampling

The paper establishes the first polynomial lower bounds on the number of parallel rounds required for diffusion sampling with approximate scores. It proves a “~Ω(d^{1/3})” lower bound for sampling smooth, near‑isotropic Gaussian mixtures in ℝ^d, and an Ω(d) lower bound for uniform sampling from anisotropic axis‑aligned boxes inside the unit ball. These bounds apply to any randomized algorithm that can make polynomially many queries per round at arbitrary locations and noise levels, while maintaining inverse‑polynomial score error and constant total variation accuracy.

By Yiwen Kou, Yimeng Wang
arXiv Machine Learning
Oct 12

Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models

The paper establishes finite‑sample guarantees for fully discrete conditional diffusion models trained from data and run with a finite number of denoising steps. By aligning the score‑training objective with the sampling grid, the authors jointly analyze statistical estimation and numerical discretization errors. For any smoothness index β>0, they prove that an appropriately chosen grid yields an averaged conditional Kullback–Leibler divergence of ˗O_p(n^{-2β/(d_x+d_y+2β)}) and a total‑variation error of ˗O_p(n^{-β/(d_x+d_y+2β)}), matching known rates up to logarithmic factors.

By Qiuyun Zhu