arXiv AI

Intrinsic Distribution Matching

Intrinsic Distribution Matching (IDM) extends distribution matching distillation (DMD) for one‑step and few‑step text‑to‑image generation by adding an explicit moment constraint that matches feature means and per‑coordinate standard deviations using the generator’s exponential‑moving‑average copy. This approach avoids a separate fake‑score network and an external feature encoder, while retaining the full DMD correction. Experiments on Z‑Image‑Turbo 6B and Qwen‑Image 20B with full‑parameter and LoRA tuning show IDM achieving the highest scores on Chinese and English LongText‑Bench, and ablations confirm the benefit of the moment loss.

arXiv Machine Learning
Oct 2

A Flow Matching Algorithm for Many-Shot Adaptation to Unseen Distributions

The paper introduces Function Projection for Flow Matching (FP‑FM), an algorithm that conditions generative models directly on samples from a target distribution. FP‑FM learns basis functions spanning velocity fields for training distributions and adapts to new distributions via a simple least‑squares projection, enabling efficient sample generation without additional training at inference time. Variants of the method trade expressivity for computational cost by enriching coefficient calculations, and the approach shows markedly better precision and recall than baselines, especially on unseen distributions.

By Tyler Ingebrand, Ruihan Zhao, Kushagra Gupta, David Fridovich-Keil, Sandeep P. Chinchali, Ufuk Topcu
arXiv AI
Oct 2

DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation

DMAD (Distribution Matching as Adversarial Distillation) reinterprets distribution matching as a classification task, enabling a few‑step student model to learn log‑density ratios directly via two discriminator heads on a shared backbone. This eliminates the need for an auxiliary diffusion model, reducing memory and computation overhead. Experiments show DMAD achieves state‑of‑the‑art Fréchet Inception Distance scores on ImageNet‑64x64, COCO‑10K, and VBench, and outperforms competing few‑step methods in joint audio‑video generation on MiniMax‑H3‑33B.

By Zhengming Yu, Junkun Yuan, Haotian Yang, Gordon Guocheng Qian, Yizhi Wang, Angtian Wang, Yiding Yang, Bo Liu, Xin Li, Wenping Wang, Chongyang Ma
arXiv Computer Vision
Oct 5

VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation

The paper introduces VDOT++, a unified distillation framework for few-step video generation across text-to-video, image-to-video, and condition-based tasks. It extends the previous VDOT method by incorporating an asymmetric unbalanced optimal transport distillation that allows student tokens to carry less mass, and an α1 ground cost that uses a weighted median to preserve modes. The approach combines distribution matching with adversarial refinement and cross-scale distillation, achieving competitive performance on multiple video benchmarks with only four sampling steps.

By Yutong Wang, Xingtong Ge, Enhuai Liu, Yunke Wang, Tianfan Xue, Yu Qiao, Yaohui Wang, Xinyuan Chen, Chang Xu