arXiv Machine Learning

Improved Training of Strong Stochastic Flow Maps

The paper introduces methods to improve training of stochastic flow maps for stochastic differential equations. It proposes representing Brownian paths with a shifted Legendre polynomial basis and using a Wong‑Zakai styled objective to enable derivative‑based losses. The authors also provide a fine‑tuning recipe that turns large pre‑trained flow models into strong stochastic flow maps, achieving a three‑fold improvement on ImageNet compared to SSFM.

arXiv AI
Jun 2

Strong Stochastic Flow Maps

arXiv:2606. 01086v1 Announce Type: cross Abstract: Flow and diffusion models generate high-quality samples in many modalities; however, many network evaluations are required during inference due to numerical integration of an underlying differential equation.

By Sam McCallum, Zander W. Blasingame, Timothy Herschell, Niklas Rindtorff, Alexander Tong, James Foster
arXiv Machine Learning
Jun 10

It\^o maps for any-step SDEs

arXiv:2606. 11156v1 Announce Type: cross Abstract: Recent one-step generative models accelerate sampling by learning deterministic flow maps of the underlying dynamics.

By Zhengkai Pan, Peter Potaptchik, Wenxi Yao, Michael S. Albergo, Jakiw Pidstrigach
arXiv Machine Learning
Oct 16

On the Stability and Convergence of Flow Map Training

The paper investigates the training dynamics of flow map models, which convert diffusion trajectories into one‑step samplers for efficient probabilistic generation. It provides a theoretical analysis of the functional gradient flow induced by MeanFlow and Lagrangian losses, proving their convergence to the true flow map and identifying the risk of unbounded updates. The authors show that adaptive normalization and a specific reweighting scheme not only bound updates but also guarantee convergence to a neighborhood of the solution, and they confirm these findings with synthetic experiments and image‑generation benchmarks.

By Ishan Nath, Tom Stanic, Avishek Joey Bose, Gauthier Gidel, Quentin Bertrand
arXiv AI
Aug 28

The Principles of Diffusion Models

The book "The Principles of Diffusion Models" outlines the foundational concepts behind diffusion models, tracing their evolution from a forward process that corrupts data into noise to a reverse process that reconstructs data. It presents three complementary perspectives—variational, score-based, and flow-based—each describing how a time-dependent velocity field transports a simple prior to the data distribution. The text also covers practical guidance for controllable generation, efficient solvers, and diffusion-inspired flow-map models, providing a mathematically grounded framework for readers with basic deep‑learning knowledge.

By Chieh-Hsin Lai, Yang Song, Dongjun Kim, Yuki Mitsufuji, Stefano Ermon
arXiv Machine Learning
Sep 11

Deep operator learning for efficient sampling from invariant measures of stochastic differential equations

The paper presents an amortized neural sampler that merges operator learning with flow-based methods to efficiently sample from invariant measures of stochastic differential equations (SDEs). By mapping SDE coefficient functions to pushforwards from a reference measure, the approach shifts the sampling cost to an initial training phase, after which new SDE instances can be sampled with a single encoder pass and a few ODE solver steps, independent of mixing time. The framework incorporates Lagrangian trajectory sensors and cross attention to handle high-dimensional problems, and the authors provide theoretical guarantees of expressivity and resolution invariance, demonstrating competitive accuracy and significant speedups over MCMC in 1D, 2D, and 64D SDE families.

By Lin Guo, Li Lei, Jingtong Zhang
arXiv AI
Oct 31

DEG: Diffusion-Enhanced GFlowNet for Solving Vehicle Routing Problems

The paper introduces Diffusion-Enhanced GFlowNet (DEG), a framework that combines Generative Flow Networks with diffusion models to improve vehicle routing problem solutions. DEG uses GFlowNet to generate edge-level signals, perturbs them with diffusion noise, and denoises them to expand flow into high-reward regions, thereby increasing solution diversity. A scalable decoder is added, and experiments on synthetic and real datasets—including up to 10,000-node instances—show DEG outperforms baseline methods.

By Ni Zhang, Zhiqin Zhang, Ling Pan, Hoong Chuin Lau, Zhiguang Cao