arXiv Machine Learning
Revisiting Spectral Representations in Generative Diffusion Models
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 9
Evaluating the Representation Space of Diffusion Models via Self-Supervised Principles
arXiv:2606. 09718v1 Announce Type: new Abstract: Diffusion models have demonstrated remarkable generative capabilities and have also emerged as powerful self-supervised representation learners, yet the connection between these two abilities remains less explored.
arXiv Machine Learning
Aug 26
Generalization, memorization, and overfitting for diffusion models trained in the lazy high-dimensional regime
The paper investigates diffusion models trained in a lazy high‑dimensional regime, extending benign overfitting theory to generative settings. By analyzing denoising score matching in a vector‑valued RKHS with an inner‑product kernel, the authors derive exact risk trajectories under gradient flow when the number of samples scales proportionally with dimensionality. These trajectories reveal three distinct phases—spectral generalization, noise‑dominated interpolation, and empirical Bayes memorization—whose interplay shapes the distribution of generated samples.
arXiv Machine Learning
Jun 8
Generalization of Diffusion Models Arises with a Balanced Representation Space
arXiv:2512. 20963v3 Announce Type: replace Abstract: Diffusion models excel at generating high-quality, diverse samples, yet they risk memorizing training data when overfit to the training objective.
arXiv AI
Jul 7
A Random Matrix Theory Perspective on the Consistency of Diffusion Models
arXiv:2602. 02908v2 Announce Type: replace-cross Abstract: Diffusion models trained on different, non-overlapping subsets of a dataset often produce strikingly similar outputs when given the same noise seed.
arXiv AI
Aug 5
Self-Supervised Representation-Guided Generative Dataset Distillation
arXiv:2608. 03218v1 Announce Type: cross Abstract: Dataset distillation compresses a large training set into a compact synthetic set while retaining its downstream utility.
arXiv Machine Learning
Jul 9
Gen4U: Unifying Video Generation and Understanding via Diffusion
arXiv:2607. 06856v1 Announce Type: cross Abstract: Prior work suggests that diffusion representations capture low-level geometry but struggle with high-level semantics.