The paper introduces Phase-wise Velocity Distillation (PVD), a method that splits the diffusion generation timeline into coarse and fine phases, each handled by a half-sized expert. By decoupling structural composition from detail refinement, PVD achieves higher quality image generation within a single full-backbone compute budget, outperforming monolithic student models. Experiments on ImageNet and text-to-image tasks show competitive FID scores and significant reductions in parameters and VRAM usage.
arXiv:2610.19305v1 Announce Type: new Abstract: One-step diffusion distillation achieves strong performance on small datasets but remains insufficient for high-resolution or complex text-to-image set...
arXiv:2607. 06631v1 Announce Type: cross Abstract: Video Diffusion Models (VDMs) have demonstrated superior generation quality but suffer from prohibitive computational costs.
Omni‑Diffusion‑Distill is a two‑stage distillation framework that compresses unified multimodal diffusion large language models (dLLMs) into a single efficient student while preserving both image generation and multimodal understanding. In the first stage the student learns to skip decoding steps by replaying cached teacher trajectories, and in the second stage it is refined on intermediate states along its own rollouts. The method introduces a pairwise collision penalty to reduce repetition in parallel text decoding and entropy‑matched guidance to prevent entropy collapse in image generation, achieving state‑of‑the‑art trade‑offs: reducing image generation from 128 to 8 steps and multimodal understanding from 512 to 64 steps, yielding 18.2× and 21.2× wall‑clock speedups and strong performance on GenEval, DPG‑Bench, MM‑Vet, and COCO captioning.
arXiv:2601. 09881v2 Announce Type: replace-cross Abstract: Large video diffusion and flow models have achieved remarkable success in high-quality video generation, but their use in real-time interactive applications remains limited due to their inefficient multi-step sampling process.
arXiv:2603.20186v2 Announce Type: replace Abstract: In this work, we propose Image-to-Image Rectified Flow Reformulation (I2I-RFR), a practical plug-in reformulation that recasts standard I2I regress...
arXiv:2609.37147v1 Announce Type: cross Abstract: Distributional Diffusion Models (DDMs) replace the standard mean-prediction denoiser with a \emph{distributional} denoiser trained via a scoring rule...
SelfLift is a progressive‑resolution framework that accelerates few‑step diffusion models by enabling late, self‑recovering transitions between low‑ and high‑resolution latents. It introduces a training‑free Artifact‑Aware Consistency Lift that uses disagreement between direct latent lifting and pixel‑VAE re‑encoding to detect and correct artifacts, and a self‑recovery policy that transfers high‑resolution guidance from an internal teacher. Experiments on FLUX.2‑Klein and Z‑Image‑Turbo show latency reductions of 41.5% and 44.1%, and overall speedups of 29.61× and 19.21× over 50‑step baselines while maintaining competitive generation quality.
arXiv:2606.03746v3 Announce Type: replace-cross Abstract: Few-step distillation has emerged as a critical component in the development of advanced visual generative foundation models, substantially r...
arXiv:2609.30988v1 Announce Type: new Abstract: Real-world image super-resolution (SR) requires recovering perceptually realistic high-resolution images from complex low-resolution observations while...
UltraDiff is a new framework for high‑resolution image generation with Latent Diffusion Models that tackles the trade‑off between computational cost and fidelity caused by latent compression. It jointly learns latent diffusion and then distills a marginal score using a dual‑branch DiT called MixTeacher, which models both f8 and f32 distributions and resolves compressed‑space ambiguity with high‑fidelity priors. Vector‑field distillation in the native f32 space forces the student model to learn the teacher’s conditional expectation, filtering out compression artifacts and achieving f8‑level quality while retaining f32 efficiency—generating a 2K image in 6.2 seconds on a single A100 GPU, over 40× faster than the f8 baseline.
arXiv:2607. 03803v1 Announce Type: cross Abstract: The growing demand for image-to-video creation on mobile devices has increasingly focused on cinematic motion effects like bullet time, dolly zoom, slow motion, etc.
arXiv:2609.23153v1 Announce Type: new Abstract: Video diffusion transformers are expensive because attention dominates long spatiotemporal token sequences. We identify the \emph{high-sparsity trap}:...