arXiv Machine Learning

Diffusion Score Estimation with Shallow Neural Networks: Regularity, Approximation, and Finite-Sample Rates

arXiv Machine Learning
Oct 9

Barron Optimal Transport I: Generative Modeling

The paper introduces a new optimal transport framework that uses the Barron energy—an intrinsic neural network complexity measure—instead of the traditional kinetic energy. By modeling transport as deep residual networks that map a reference distribution to a target distribution, the authors define a new metric on probability measures and analyze its properties for generative modeling. They demonstrate that diffusion generative models are suboptimal in this Barron geometry and explore how adaptivity can improve alternative generative approaches.

By Evan Dogariu, Joan Bruna
arXiv Statistics ML
Oct 2

Sample complexity bounds for categorical Markov random fields via Discrete Diffusions

The paper presents sample complexity bounds for sampling high‑dimensional categorical distributions with local dependence using discrete diffusions. It introduces a pinning decomposition of the discrete score, enabling a weight‑sharing neural score learner combined with τ‑leaping for efficient end‑to‑end sampling. The authors derive explicit guarantees that depend on vocabulary size, MRF interaction order, and sample size, and demonstrate that weight‑sharing networks outperform fully connected ones on Potts, Ising, and tree‑structured models.

By Shivam Kumar, Nabarun Deb