arXiv Machine Learning By Sophia Tang, Shiyi Wang

Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning

Read the original on arXiv Machine Learning →

Discrete Beckmann Transport Models (DBTM) are introduced as a new type of discrete diffusion and flow model that can generate language in a single step by mapping any point to a fixed point on the simplex vertices. Unlike previous approaches, DBTM eliminates the need for a pretrained teacher model and time conditioning by minimizing a conservation equation directly from data. The model can be partially trained and iterated until convergence, and it can be extended to a partial‑context interpolant that refines outputs with additional function evaluations. Experiments on language modeling and reasoning tasks show that DBTM achieves higher quality and accuracy than existing discrete diffusion and continuous flow baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jul 24

Expanding Flow Maps

arXiv:2607. 21585v1 Announce Type: new Abstract: Flow-based generative models have enabled remarkable progress in fast and controllable generation across continuous and discrete state spaces, yet existing parameterizations are constrained to fixed dimensions or fixed sequence lengths.

By Sophia Tang, Pranam Chatterjee
arXiv Machine Learning
Jun 29

Masked Language Flow Models

arXiv:2606. 27617v1 Announce Type: cross Abstract: Masked Diffusion Models (MDMs) promise fast, parallel language generation, but their reverse transition factorises across token positions -- an approximation that breaks down in the few-step sampling regime where parallel generation ought to provide the greatest efficiency gains.

By Iskander Azangulov, Kianoosh Ashouritaklimi, Leo Zhang, Simon Vary, Patrick Rebeschini
arXiv Machine Learning
Jun 2

Consistent Diffusion Language Models

arXiv:2605. 00161v2 Announce Type: replace Abstract: Diffusion language models (DLMs) are an attractive alternative to autoregressive models because they promise sublinear-time, parallel generation, yet practical gains remain elusive as high-quality samples still demand hundreds of refinement steps.

By Hasan Amin, Yuan Gao, Yaser Souri, Subhojit Som, Ming Yin, Rajiv Khanna, Xia Song