arXiv Machine Learning

Continuous Adversarial MeanFlow Transfer

arXiv:2608. 19540v1 Announce Type: new Abstract: Training fast generators on new domains with limited data remains challenging for two reasons.

Hugging Face Trending Papers
Aug 20

Continuous Adversarial MeanFlow Transfer

Training fast generators on new domains with limited data remains challenging for two reasons. First, adapting a pretrained diffusion or flow model to a new domain leaves its costly multi-step sampling unaddressed, and existing acceleration methods are tied to the source parameterization--$ε$, $x$, $v$, or $u$--leaving heterogeneous pretrained models with no common acceleration target.

arXiv Machine Learning
Aug 27

Continuous Adversarial Flow Models

The paper introduces continuous adversarial flow models, a continuous-time flow framework trained with an adversarial objective that replaces the fixed mean-squared-error criterion of flow matching. By incorporating a learned discriminator, the method guides training toward a different generalized distribution, yielding samples more closely aligned with the target data distribution. Applied as a post‑training step, it markedly improves ImageNet 256px generation metrics—reducing the guidance‑free FID of latent‑space SiT from 8.26 to 3.63 and of pixel‑space JiT from 7.17 to 3.57—and also enhances guided generation and text‑to‑image benchmarks.

By Shanchuan Lin, Ceyuan Yang, Zhijie Lin, Hao Chen, Haoqi Fan
arXiv Machine Learning
Sep 22

When Does Adversarial Refinement Help? A Negative Result and Open Problem in Adapting R3GAN to Time Series Imputation

The paper investigates whether the stable GAN architecture R3GAN can improve time‑series imputation when adapted to 1‑D temporal data. Using a coarse‑to‑fine refinement framework and a frequency‑domain discriminator, the authors evaluate 14 saved configurations across three datasets and find a negative result: most configurations either show negligible improvement or degrade performance compared to baseline methods. The study highlights that the usual argument—GANs optimize distributional objectives rather than point‑wise ones—does not fully explain the lack of benefit, and it poses an open problem regarding why a learned discriminator fails to provide useful refinement gradients while diffusion denoisers succeed, offering practical guidance on when adversarial refinement may be worthwhile.

By Yufeng He
arXiv Machine Learning
3d ago

PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation

The paper introduces PotentialEP, a backpropagation‑free method for training generative models at CIFAR scale using Equilibrium Propagation. It shows that a predictive coding network with a small linear injection can relax to a state that inherently carries the gradient needed for sampling, allowing an Energy Matching model trained with backpropagation to be sampled by relaxation alone with negligible loss in FID. Moreover, the authors demonstrate that training end‑to‑end with Equilibrium Propagation yields FID scores comparable to backpropagation, marking the first competitive CIFAR‑10 generative model trained without backpropagation.

By Alex Gower
arXiv Machine Learning
3d ago

On the Stability and Convergence of Flow Map Training

The paper investigates the training dynamics of flow map models, which convert diffusion trajectories into one‑step samplers for efficient probabilistic generation. It provides a theoretical analysis of the functional gradient flow induced by MeanFlow and Lagrangian losses, proving their convergence to the true flow map and identifying the risk of unbounded updates. The authors show that adaptive normalization and a specific reweighting scheme not only bound updates but also guarantee convergence to a neighborhood of the solution, and they confirm these findings with synthetic experiments and image‑generation benchmarks.

By Ishan Nath, Tom Stanic, Avishek Joey Bose, Gauthier Gidel, Quentin Bertrand
arXiv Machine Learning
Aug 13

Fine-Tuning Generative Models for Extreme Events via CVaR-Penalized Wasserstein Gradient Flows

arXiv:2608. 11544v1 Announce Type: cross Abstract: We propose CVaR-penalized Generative Particle Algorithm (CVaR-GPA), a robust, tail-agnostic algorithm for fine-tuning generative models to learn heavy-tailed distributions and capture extreme events, requiring no prior knowledge or estimation of the target's tail characteristics.

By Thejani Gamage, Hyemin Gu, Zhizhen Zhang, Ziyu Chen, Markos Katsoulakis, Luc Rey-Bellet