Score distillation turns a pretrained 2D diffusion model into a 3D generator, but the per-step gradient is estimated from a single randomly chosen view: it is high-variance and blind to global shape consistency. Prior work addresses this by retraining the diffusion prior on multi-view data; this improves consistency but makes the sampling contribution inseparable from prior quality.
arXiv:2610.20220v1 Announce Type: new
Abstract: Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today's dominant approach distills a b...
By Zhuobai Dong, Junchao Yi, Hu Jian Guo, Linjie Li, Rui Zhao, Alex Jinpeng Wang
The paper introduces ReSeed, a lightweight post‑distillation technique that restores lost diversity in diffusion model distillation by adding a seed‑response bias adapter only to the first denoising step. By aligning the first step’s velocity with the teacher’s, ReSeed recovers most of the output diversity without altering later steps or adding target images. Experiments on SD3‑Medium, SD3.5‑Medium, FLUX.1‑dev, and Wan2.1‑T2V‑1.3B show a 48.3% increase in DINO diversity with negligible extra parameters and training data.
By Wenwu Tang, Dong Wang, Yun Cheng, Olga Saukh
arXiv:2604. 16514v5 Announce Type: replace-cross Abstract: Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bottleneck.
By Baoyou Chen, Hanchen Xia, Peng Tu, Haojun Shi, Liwei Zhang, Yuxuan Yao, Weihao Yuan, Siyu Zhu
Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today's dominant approach distills a bidirectional diffusion model into a causal few-st...
arXiv:2610.19305v1 Announce Type: new
Abstract: One-step diffusion distillation achieves strong performance on small datasets but remains insufficient for high-resolution or complex text-to-image set...
By Ngoc Duy Tran, Kien Do, Duc Thanh Nguyen, Truyen Tran