How I learned to stop worrying and love StopGrads: Stationarity, Convergence, and a case study on Flow Map Learning
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The paper investigates the training dynamics of flow map models, which convert diffusion trajectories into one‑step samplers for efficient probabilistic generation. It provides a theoretical analysis of the functional gradient flow induced by MeanFlow and Lagrangian losses, proving their convergence to the true flow map and identifying the risk of unbounded updates. The authors show that adaptive normalization and a specific reweighting scheme not only bound updates but also guarantee convergence to a neighborhood of the solution, and they confirm these findings with synthetic experiments and image‑generation benchmarks.
arXiv:2607. 26398v1 Announce Type: new Abstract: Diffusion and flow-based models benefit from simple regression losses, but inference incurs significant overhead because sampling requires integration.
arXiv:2607. 00535v1 Announce Type: cross Abstract: Few-step flow-map generators, such as consistency models and MeanFlow, accelerate sampling by directly learning long-range transport maps between noise and data.
arXiv:2606. 30376v1 Announce Type: new Abstract: Aligning generative flow models on continuous spaces via online reinforcement learning is constrained by intractable trajectory likelihoods.
arXiv:2606. 05888v1 Announce Type: new Abstract: Retry-based objectives such as pass@K and max@K optimize the best return obtained from multiple sampled trajectories, and recent work has shown that they can promote exploration without explicit exploration bonuses.
arXiv:2606. 16073v1 Announce Type: new Abstract: Sampling from complex, unnormalized probability densities is a fundamental challenge in Bayesian inference and probabilistic modeling.