arXiv Machine Learning

Bernoulli Flow Models: Self-Consistent Generative Modeling for Binary Data

Bernoulli Flow Models (BFM) introduce a continuous global Bernoulli probability flow path for binary data generation, replacing sequential one‑step Markov diffusion chains. By deriving analytical closed‑form posterior transitions over arbitrary time intervals, BFM eliminates the need for approximating multi‑step likelihoods and allows inference with far fewer function evaluations while maintaining sample quality. Experiments demonstrate that a BFM trained with 256 steps achieves an FID of 9.22 on LSUN Churches 256×256 using only 16 sampling steps, outperforming state‑of‑the‑art discrete baselines and remaining competitive under full‑step inference.

arXiv Machine Learning
Jun 2

Consistent Diffusion Language Models

arXiv:2605. 00161v2 Announce Type: replace Abstract: Diffusion language models (DLMs) are an attractive alternative to autoregressive models because they promise sublinear-time, parallel generation, yet practical gains remain elusive as high-quality samples still demand hundreds of refinement steps.

By Hasan Amin, Yuan Gao, Yaser Souri, Subhojit Som, Ming Yin, Rajiv Khanna, Xia Song
arXiv Machine Learning
Jun 10

It\^o maps for any-step SDEs

arXiv:2606. 11156v1 Announce Type: cross Abstract: Recent one-step generative models accelerate sampling by learning deterministic flow maps of the underlying dynamics.

By Zhengkai Pan, Peter Potaptchik, Wenxi Yao, Michael S. Albergo, Jakiw Pidstrigach
arXiv AI
Sep 3

GeoSPRINT: Geometric Redundancy-Aware Step Pruning for Inference in Diffusion Trajectories

GeoSPRINT is a training‑free framework that constructs non‑uniform sampling schedules for diffusion model inference by detecting geometrically redundant steps in denoising trajectories. It uses a hyperplanarity test in latent space, implemented via QR factorization, to allocate more steps to high‑curvature regions, and introduces the trajectory projection score α_traj as a model‑free diagnostic for flow quality. Across CIFAR‑10, LSUN Church, and Stable Diffusion v1.5, GeoSPRINT consistently outperforms uniform DDIM schedules at matched NFE budgets, improving FID scores by up to 1.93 points.

By Arpita Joshi
arXiv Machine Learning
Sep 23

One-Step Generative Surrogate Models via Block-Triangular Joint Drifting

The paper introduces block‑triangular joint drifting, a method that applies a projected drift field to the joint distribution of consecutive states, enabling one‑step generative surrogate models for stochastic transition dynamics. This architecture preserves the current‑state marginal while directly sampling the conditional distribution of next states, allowing stochastic trajectories to be generated with a single model evaluation per time step. Experiments show that the approach achieves accurate marginal and trajectory‑dependent statistics with favorable accuracy‑cost tradeoffs compared to deterministic, diffusion, flow, and distillation‑based generative surrogates.

By Nicholas Geissler, Shreya Jha, Ricardo Baptista, Benjamin Peherstorfer
arXiv AI
Oct 12

ReSFlow: Rectifying Categorical Flows on Statistical Manifolds for One-Step Generation

ReSFlow is a generative model that learns geodesic trajectories on statistical manifolds to enable one‑step categorical generation. By rectifying continuous‑time flows to follow intrinsic Riemannian geometry, it reduces transport cost and eliminates the need for multi‑step numerical integration. Experiments across image, text, and biological datasets show that ReSFlow achieves superior one‑step generation quality compared to prior methods.

By Xiaohuan Jia, Renzhe Xu, Xiao Wang, Jiayun Wu, Shaohua Fan
arXiv Machine Learning
Sep 11

Particle GFlowNets: Rethinking Generative Marginalization Models

The paper introduces Particle GFlowNets, showing that Generative Marginalization Models (MaMs) are equivalent to Generative Flow Networks. It extends MaMs to non‑autoregressive sampling and proposes an automatic full‑state rejuvenation criterion based on the Gelman‑Rubin statistic to accelerate learning. Experiments demonstrate significant training speedups in large combinatorial spaces.

By Tiago da Silva, Diego Mesquita, Salem Lahlou