arXiv Machine Learning By Nicolas Brosse, Arnak S. Dalalyan

Universal Local Error and Realized Amplification for the First-Order EDM Predictor

Read the original on arXiv Machine Learning →

arXiv:2610. 10190v1 Announce Type: cross Abstract: We analyze the first-order deterministic diffusion sampler of Karras et al.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
3d ago

Information-Theoretic Scaling Laws for Generative Diffusion Training

The paper introduces an information-theoretic measure called model information to quantify how much a diffusion model’s outputs depend on its specific training dataset. By analyzing how this measure scales with model size and dataset size, the authors identify two distinct regimes: a nonlinear regime where memorization transitions to imperfect generalization, and a linear regime where generalization improves and sample quality rises. They propose a scaling law that captures these regimes and demonstrate that it can predict memorization and sample quality beyond the fitted data range.

By Druv Pai, Dejan Stancevic, Yi Ma, Luca Ambrogioni