arXiv Machine Learning By Paribesh Regmi, Rui Li

Cumulative Marginal Matching for One-Step Diffusion

Read the original on arXiv Machine Learning →

The paper introduces Cumulative Marginal Matching (CMM), a new objective for training few‑step diffusion and flow‑matching models. CMM treats flow‑matching as a sequence of intermediate marginal distributions and directly optimizes the cumulative Wasserstein‑2 discrepancy between the base and few‑step models across the entire trajectory. It derives a tractable surrogate for this objective, shows that Shortcut‑CSL is a first‑order approximation of CMM, and reports improved generation quality on standard benchmarks under the same training budget.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 10

MMD Guidance: Training-Free Distribution Adaptation for Diffusion Models via Maximum Mean Discrepancy Guidance

arXiv:2601. 08379v2 Announce Type: replace-cross Abstract: Pre-trained diffusion models have emerged as powerful generative priors for both unconditional and conditional sample generation, yet their outputs often deviate from the characteristics of user-specific target data.

By Matina Mahdizadeh Sani, Nima Jamali, Mohammad Jalali, Farzan Farnia
arXiv AI
5d ago

Preconditioned Flow Matching

Preconditioned Flow Matching introduces a precondition-then-match framework that transforms target distributions into more isotropic representations before training flow matching models. By reshaping intermediate distributions, the method improves conditioning, leading to better low-eigenvalue recovery and enhanced performance metrics such as FID, MMD, precision, and recall across Gaussian, Gaussian-mixture, and high-resolution image datasets. The approach is theoretically justified and empirically validated, with ablations showing gains stem from improved geometry rather than extra parameters.

By Shadab Ahamed, Eshed Gal, Md Shahriar Rahim Siddiqui, Simon Ghyselincks, Moshe Eliasof, Eldad Haber