The paper introduces a generalized score matching objective for parameter estimation on convex subsets of ρ^d, derived from Minimum Probability Flow learning. It shows that this objective is a proper local scoring rule of second order, ensuring recovery of the true density when minimized, and proves convexity and consistency for exponential family models under standard conditions. Experiments demonstrate the method’s effectiveness on constrained domains where the partition function is intractable, including a generative modeling use‑case.
By Nishanth Shetty, Saisuchith Mahajan, Chandra Sekhar Seelamantula
arXiv:2606. 19876v1 Announce Type: new Abstract: The score matching problem is a central training objective in modern generative modeling, diffusion models, fitting unnormalized statistical models, and inverse problems.
By Alexander Tyurin
arXiv:2610. 02663v1 Announce Type: cross Abstract: Despite the remarkable empirical success of flow-matching models, their statistical generalization guarantees remain underdeveloped.
By Saptarshi Chakraborty, Quentin Berthet, Peter L. Bartlett
arXiv:2504.05161v2 Announce Type: replace-cross
Abstract: Score estimation is the backbone of score-based generative models (SGMs), especially denoising diffusion probabilistic models (DDPMs). A key...
By Sinho Chewi, Alkis Kalavasis, Anay Mehrotra, Omar Montasser
arXiv:2511. 03963v3 Announce Type: replace-cross Abstract: We introduce a density-power weighted variant of the Stein operator, called the $\gamma$-Stein operator, for robust inference with unnormalized probability models.
By Shinto Eguchi
arXiv:2610.07228v1 Announce Type: cross
Abstract: Natural gradient descent (NGD) underlies common methods in ML. For dually flat families, idealized NGD on the forward Kullback--Leibler objective fol...
By Guni Sharon, Alan Kuhnle