arXiv AI

Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data

arXiv:2610. 02663v1 Announce Type: cross Abstract: Despite the remarkable empirical success of flow-matching models, their statistical generalization guarantees remain underdeveloped.

arXiv Machine Learning
Jun 30

Robustness and Structure Preservation in Flow-Based Generative Models via Wasserstein Path-Space Divergences

arXiv:2410. 01244v2 Announce Type: replace-cross Abstract: We introduce a novel Wasserstein-1 ($W_1$) path-space divergence for stochastic and deterministic dynamics and establish a Wasserstein Uncertainty Propagation (WUP) theorem that bounds the $W_1$ distance between terminal distributions by the proposed divergence, equivalently characterized by a weighted $L^2$ discrepancy between the underlying drifts and the $W_1$ distance between their initial measures.

By Ziyu Chen, Markos A. Katsoulakis, Benjamin J. Zhang
arXiv Machine Learning
6d ago

Generalised Score Matching on Convex Domains

arXiv:2609. 11521v2 Announce Type: replace Abstract: Score matching avoids computing the normalising constant that maximum-likelihood estimation requires.

By Nishanth Shetty, Saisuchith Mahajan, Chandra Sekhar Seelamantula
arXiv Machine Learning
Aug 31

When Can Conditional Flow Matching Replace Pointwise Negative Log-Likelihood?

The paper investigates when conditional flow matching (CFM) can replace pointwise negative log-likelihood (NLL) calculations. It shows that for linear Gaussian paths, the endpoint NLL can be exactly decomposed into entropy, a weighted CFM objective, and residual terms, meaning CFM-only estimates are exact only when these residuals cancel. The study finds that ordinary CFM is generally not a pointwise NLL estimator, and even weighted variants may not fully eliminate bias, especially in training or on‑policy settings, with experiments confirming these theoretical insights.

By Yansen Han, Hongxin Sun, Tao Lin