arXiv AI
Denoising Diffusion Generative Models Secretly Calculate Attentions
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 2
You Don't Need All That Attention: Surgical Memorization Mitigation in Text-to-Image Diffusion Models
arXiv:2603. 00133v2 Announce Type: replace-cross Abstract: Generative models have been shown to "memorize" certain training data, leading to verbatim or near-verbatim generating images, which may cause privacy concerns or copyright infringement.
Hugging Face Trending Papers
Jun 10
Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
Diffusion large language models (dLLMs) offer an efficient alternative to autoregressive models through parallel decoding, yet existing post-training methods largely rely on random masking strategies that overlook intrinsic token dependencies. In this work, we present an empirical analysis of attention in dLLMs and show that tokens attending more strongly to unmasked context exhibit greater generation stability and play a critical role in reasoning.
arXiv AI
Jun 2
DyLLM: Efficient Diffusion LLM Inference via Saliency-based Token Selection and Partial Attention
arXiv:2603. 08026v2 Announce Type: replace-cross Abstract: Masked diffusion language models enable parallel token decoding, providing a promising alternative to the sequential nature of autoregressive generation.
arXiv Computer Vision
2d ago
Rethinking Memorization Mitigation in Diffusion Models: Reinforcing Text Conditioning
arXiv:2610.01723v1 Announce Type: new Abstract: Text-to-image diffusion models have achieved remarkable progress in image synthesis, yet can exhibit memorization by closely reproducing individual tra...
arXiv Computer Vision
3d ago
Looped Diffusion Transformer
arXiv:2609.40305v1 Announce Type: new Abstract: Improving text-to-image models has traditionally relied on increasing model size or the number of denoising steps. In this work, we explore an alternat...
arXiv Machine Learning
Jun 30
Generalization Analysis of Transformers in Distribution Regression
arXiv:2606. 29256v1 Announce Type: cross Abstract: In recent years, models based on the Transformer architecture have seen widespread applications and have become one of the core tools in the field of deep learning.