arXiv Computer Vision
Distribution Matching Distillation without Fake Score Network
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Oct 9
Few-Step Generation via Data-Space Iteration
The paper introduces data‑space iteration, a few‑step generation framework that eliminates the need for a fixed probability‑flow discretization. By refining predictions directly in data space with a shared generator, each iteration is trained to produce the best possible sample within its capacity. Experiments on class‑conditional ImageNet 256×256 show that data‑space iteration outperforms standard discretization baselines and matches or improves upon schedule‑searched variants without schedule‑specific training.
arXiv Machine Learning
Oct 8
Consistent Distribution Matching for Data-Free Diffusion Distillation
Consistent Distribution Matching is a data‑free distillation technique that accelerates diffusion and flow models by unifying sample generation and score estimation in a single student network. The method requires only a frozen teacher and a trainable student, optimizing a single objective that provably leads to Wasserstein convergence of the student’s flow‑map to the teacher’s marginals. On ImageNet 256×256, it achieves an FID of 2.04 with one function evaluation and 1.37 with four evaluations after just 40 training epochs, outperforming existing data‑free baselines.
Hugging Face Trending Papers
Oct 6
Consistent Distribution Matching for Data-Free Diffusion Distillation
Flow and diffusion models suffer from slow inference due to computationally expensive numerical integration. Distillation provides a promising way for a student model to learn from a teacher's dynamic...
arXiv Machine Learning
Jun 9
Optimizing Few-Step Generation with Adaptive Matching Distillation
arXiv:2602. 07345v2 Announce Type: replace-cross Abstract: Distribution Matching Distillation (DMD) is a powerful acceleration paradigm, yet its stability is often compromised in Forbidden Zone, regions where the real teacher provides unreliable guidance while the fake teacher exerts insufficient repulsive force.
arXiv Machine Learning
Sep 24
WTF?! Simulation-Free Reinforcement Learning with Wasserstein-Tilted Flow Maps
The paper introduces Wasserstein‑Tilted Flow Maps (WTF), a simulation‑free reinforcement learning method that fine‑tunes pre‑trained flow‑based generative models by adding an optimal transport regularizer derived from the model’s drift. Unlike traditional KL‑reward tilting, WTF transports individual samples toward higher reward, framing the problem as a deterministic optimal control task on the flow map. Experiments on ImageNet‑256 and text‑to‑image demonstrate that WTF achieves higher reward and comparable or better diversity while reducing training compute by up to 280×.
arXiv Computer Vision
1d ago
VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation
arXiv:2611.06796v1 Announce Type: new Abstract: Few-step distillation offers efficient generation with diffusion and flow models, but preserving quality with only a few sampling steps remains challen...