arXiv Machine Learning

Order-Optimal Sample Complexity of Rectified Flows

arXiv Machine Learning
Aug 10

Limit Points of Reflow with Minibatch Optimal Transport

arXiv:2608. 07042v1 Announce Type: cross Abstract: Rectified flows, also called flow matching or stochastic interpolants, are generative models that learn a time-dependent vector field steering a probability curve between two probability distributions, usually referred to as latent and target distributions.

By Antonin Chambolle, Johannes Hertrich
Hugging Face Trending Papers
Jun 29

The Fundamental Limits of Valid Transport Map Estimation

Many modern generative modeling methods, including diffusion models, normalizing flows, and flow matching, estimate transport maps or plans between distributions without explicitly targeting an optimal transport (OT) map. In applications like generative modeling, the transport cost itself is irrelevant, and this makes it natural to target maps which are more tractable from either a statistical or computational standpoint.

arXiv Machine Learning
3d ago

Barron Optimal Transport I: Generative Modeling

The paper introduces a new optimal transport framework that uses the Barron energy—an intrinsic neural network complexity measure—instead of the traditional kinetic energy. By modeling transport as deep residual networks that map a reference distribution to a target distribution, the authors define a new metric on probability measures and analyze its properties for generative modeling. They demonstrate that diffusion generative models are suboptimal in this Barron geometry and explore how adaptivity can improve alternative generative approaches.

By Evan Dogariu, Joan Bruna
arXiv Machine Learning
Sep 3

CAT-Flow: Curvature-Adaptive sTeps for Flow Matching

The paper introduces CAT-Flow, a pair of lightweight, training‑free algorithms—CAT‑OV and CAT‑OT—that adapt step‑sizes during Flow Matching inference by estimating curvature in time or state space. These methods avoid extra neural evaluations and achieve constant‑order truncation error bounds. Experiments show that CAT‑OV and CAT‑OT improve image quality metrics across four text‑to‑image Flow Matching models, cutting the required generation steps by up to 40%.

By Qinchan Li, Pedro Cisneros-Velarde, Keru Fu, Samuel Antunes Miranda, Sharan Vaswani, Hao Zhang
arXiv AI
Jul 7

Efficient Flow Matching for Sparse-View CT Reconstruction

arXiv:2603. 00205v2 Announce Type: replace-cross Abstract: Generative models, particularly Diffusion Models (DM), have shown strong potential for Computed Tomography (CT) reconstruction serving as expressive priors for solving ill-posed inverse problems.

By Jiayang Shi, Lincen Yang, Zhong Li, Tristan van Leeuwen, Daniel M. Pelt, K. Joost Batenburg
arXiv AI
Oct 5

Depth as Time in One-Step Generative Models

The paper investigates how one-step generative models, which compress multi-step diffusion processes, handle denoising across a single forward pass. It introduces the concept of "depth as time," showing that intermediate layers of a model can be decoded to reveal a denoising trajectory similar to multi-step diffusion. The study finds that models trained with a time-indexed transport task, such as MeanFlow, exhibit this depthwise denoising and can be highly compressed, whereas models without such a task do not show the same behavior.

By Arnold Caleb Asiimwe, William Yang, Sanghyuk Chun, Esin Tureci, Olga Russakovsky