arXiv:2601. 22651v2 Announce Type: replace-cross Abstract: Training-data attribution for vision generative models aims to identify which training data influenced a given output.
By Naoki Murata, Yuhta Takida, Chieh-Hsin Lai, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji
The paper investigates how repeatedly training score-based diffusion models on synthetic data can cause their outputs to drift from the target distribution. It provides theoretical upper and lower bounds on the divergence accumulated over successive training rounds, distinguishing regimes based on score estimation error and the fraction of fresh data used. Empirical experiments on synthetic data and images support the theoretical findings.
By Nail B. Khelifa, Richard E. Turner, Ramji Venkataramanan
arXiv:2310. 05264v5 Announce Type: replace Abstract: In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often yield remarkably similar outputs.
By Huijie Zhang, Jinfan Zhou, Yifu Lu, Minzhe Guo, Peng Wang, Liyue Shen, Qing Qu
The paper introduces MUCS, a method for training data attribution (TDA) in diffusion models that uses mirrored unlearning and noise-consistent skew. By fine-tuning a second model with bounded mirrored gradient ascent and measuring its normalized skew relative to the original model using consistent noise samples, MUCS achieves significantly better performance than existing TDA methods across three datasets. The authors also explore design choices, overlap of influential instances, and the potential of ensembling TDA approaches.
By Joan Serr\`a, Dipam Goswami, Fabio Morreale, Wei-Hsiang Liao, Yuki Mitsufuji
arXiv:2610.19042v1 Announce Type: new
Abstract: Understanding the mechanism behind why diffusion models memorize their training data remains an open question in generative modeling. In this paper, we...
By Shashank Sule, Xinyue Yu, Boonam Shin, Yuxuan Liu, Abolfazl Hashemi, Hayden Schaeffer
arXiv:2609.40235v1 Announce Type: cross
Abstract: Continuous diffusion language models generate all tokens in parallel, yet high-quality generation can still require hundreds of network evaluations (...
By Paul Le Van Kiem, Dario Shariatian, Umut Simsekli, Alain Durmus
Understanding the mechanism behind why diffusion models memorize their training data remains an open question in generative modeling. In this paper, we examine this question from two perspectives: (a)...
The paper introduces CADT, a Concept Attribution method through Dynamic Trajectories, which attributes diffusion model outputs by tracking factor-induced internal response trajectories rather than scalar responses. CADT constructs matched counterfactual pairs at identical noisy states to isolate factor-specific representation displacements and models their directional and magnitude evolution across denoising as dynamic attribution signatures. Experiments on multiple public datasets demonstrate consistent improvements over existing diffusion attribution baselines for hierarchical, compositional, and style attribution tasks.
By Haoqian Zhang, Ziyuan Yang, Zerui Shao, Yi Zhang
The paper introduces pass@k, a metric that evaluates how well generative diffusion models cover their output distribution by measuring the probability that at least one of k independent samples meets a quality criterion. Using this metric, the authors show that while classifier‑free guidance improves single‑draw quality, its advantage diminishes or reverses as k increases, revealing a trade‑off between quality and distribution coverage. They further demonstrate that the choice of training objective in diffusion distillation—whether distribution‑matching or consistency/trajectory‑based—determines whether a few‑step model retains its teacher’s coverage or sacrifices it for higher single‑draw performance, a phenomenon that also appears in few‑step causal video generation.
By Yifei Wang, Xiaoyu Wu, Tsu-Jui Fu, Chen Chen, Liang-Chieh Chen, Zhe Gan, Chen Wei
arXiv:2609.37974v1 Announce Type: cross
Abstract: Masked diffusion models (MDMs) generate text by unmasking several tokens per step, but they are trained and sampled under different conditions. The m...
By Manuel Madeira, Amitis Shidani, Alice Bizeul, Victor Turrisi, Louis B\'ethune, Bhavika Devnani, Dan Busbridge, Pierre Ablin, Jo\~ao Monteiro
Consistent Distribution Matching is a data‑free distillation technique that accelerates diffusion and flow models by unifying sample generation and score estimation in a single student network. The method requires only a frozen teacher and a trainable student, optimizing a single objective that provably leads to Wasserstein convergence of the student’s flow‑map to the teacher’s marginals. On ImageNet 256×256, it achieves an FID of 2.04 with one function evaluation and 1.37 with four evaluations after just 40 training epochs, outperforming existing data‑free baselines.
By Yuxiang Fu, Qi Yan, Zike Wu, Yongxing Zhang, Purang Abolmaesumi, Lele Wang, Renjie Liao
arXiv:2608.30081v1 Announce Type: new
Abstract: Understanding which training samples influence a generated image is an important problem in generative modeling. In flow matching, training samples inf...
By Rania Briq, Ohad Fried, Michael Kamp, Stefan Kesselheim