arXiv Computer Vision
Oct 28

SpeeDiff: Scalable Pixel-Anchored End-to-End Latent Diffusion Model

SpeeDiff is a latent diffusion model that jointly trains a VAE and diffusion network from scratch, using a Tweedie Pixel Reconstruction loss to prevent latent collapse. The approach allows scaling a transformer‑based architecture and improves representation alignment. Experiments show the SpeeDiff‑XL model trains 140× faster than Vanilla SiT and 61× faster than REPA, achieving an FID of 1.50 on ImageNet 256×256 and 1.53 on 512×512 without guidance.

By Bingliang Zhang, Wenda Chu, Yizhuo Li, Linjie Yang, Yisong Yue, Katherine L. Bouman, Yang Song, Qiushan Guo
arXiv AI
Oct 19

Rethinking the design space of Vanilla Pixel Diffusion Transformers

The paper revisits pixel-space diffusion models, showing that a vanilla diffusion transformer can generate directly in pixel space by swapping velocity prediction for clean image prediction. It introduces MFlow, an adaptive parameterization that interpolates between these two prediction modes based on data representation and model capacity, and demonstrates competitive performance on ImageNet, UCF‑101, and text‑to‑image tasks. Additionally, the authors add ConvRefiner, a lightweight convolutional module trained post‑hoc to restore high‑frequency details while preserving FID.

By Soumik Mukhopadhyay, Long Mai, Abhinav Shrivastava, Aniruddha Mahapatra