Sig-DEG for Distillation proposes a Signature-based Differential Equation Generator to distill pre-trained diffusion models. By combining partial signatures of Brownian motion with a recurrent structure, it approximates stochastic differential equation solutions and formulates distillation as supervised learning on coarse time grids. The method enables fast inference, achieving up to several hundred‑fold speedups while maintaining competitive sample quality in image and time‑series generation, and extends to applications like Schrödinger bridges.
arXiv:2509. 22454v2 Announce Type: replace Abstract: Electrostatic generative models such as PFGM++ have recently emerged as a powerful framework, achieving competitive performance in image synthesis.
Consistent Distribution Matching is a data‑free distillation technique that accelerates diffusion and flow models by unifying sample generation and score estimation in a single student network. The method requires only a frozen teacher and a trainable student, optimizing a single objective that provably leads to Wasserstein convergence of the student’s flow‑map to the teacher’s marginals. On ImageNet 256×256, it achieves an FID of 2.04 with one function evaluation and 1.37 with four evaluations after just 40 training epochs, outperforming existing data‑free baselines.
arXiv:2609.37147v1 Announce Type: cross Abstract: Distributional Diffusion Models (DDMs) replace the standard mean-prediction denoiser with a \emph{distributional} denoiser trained via a scoring rule...
Flow and diffusion models suffer from slow inference due to computationally expensive numerical integration. Distillation provides a promising way for a student model to learn from a teacher's dynamic...
The paper introduces Probability‑Flow Distillation (PFD), a new method for matching parameter distributions in diffusion‑based models. It extends the particle variational inference framework of Variational Score Distillation to Score Distillation Sampling (SDS) and Score Distillation via Inversion (SDI), revealing that SDS focuses on mode collapse while SDI converges to a contracted distribution. By replacing a single Euler step in SDI with a full reverse probability‑flow ODE solve and simplifying the gradient, PFD achieves distribution matching with only a forward ODE solve, and experiments on synthetic data, CelebA, and text‑to‑3D tasks confirm its effectiveness.
arXiv:2606. 11156v1 Announce Type: cross Abstract: Recent one-step generative models accelerate sampling by learning deterministic flow maps of the underlying dynamics.
arXiv:2505. 22391v2 Announce Type: replace-cross Abstract: Modeling physical systems in a generative manner offers several advantages, including the ability to handle partial observations, generate diverse solutions, and address both forward and inverse problems.
arXiv:2602. 19066v2 Announce Type: replace-cross Abstract: Diffusion Language Models (DLMs) have recently achieved strong results in text generation.
arXiv:2605. 00161v2 Announce Type: replace Abstract: Diffusion language models (DLMs) are an attractive alternative to autoregressive models because they promise sublinear-time, parallel generation, yet practical gains remain elusive as high-quality samples still demand hundreds of refinement steps.
arXiv:2602.15396v2 Announce Type: replace Abstract: Diffusion models often yield highly curved trajectories and noisy score targets due to an uninformative, memoryless forward process that induces in...
arXiv:2606. 01086v1 Announce Type: cross Abstract: Flow and diffusion models generate high-quality samples in many modalities; however, many network evaluations are required during inference due to numerical integration of an underlying differential equation.
arXiv:2607. 06631v1 Announce Type: cross Abstract: Video Diffusion Models (VDMs) have demonstrated superior generation quality but suffer from prohibitive computational costs.