OpenAI Blog

Simplifying, stabilizing, and scaling continuous-time consistency models

Read the original on OpenAI Blog →

We’ve simplified, stabilized, and scaled continuous-time consistency models, achieving comparable sample quality to leading diffusion models, while using only two sampling steps.

Summary generated by The Flow from the publisher's feed. The full article lives at OpenAI Blog.

OpenAI Blog
Jun 20, 2024

Consistency Models

Diffusion models have significantly advanced the fields of image, audio, and video generation, but they depend on an iterative sampling process that causes slow generation.

arXiv Machine Learning
Jul 3

A Mathematical Introduction to Diffusion Models

arXiv:2607. 01693v1 Announce Type: new Abstract: These notes give a proof-oriented introduction to diffusion models from the viewpoint of sampling, tracing a single arc from classical sampling dynamics to modern diffusion samplers, their error analysis, and inference-time control.

By Jianfeng Lu
arXiv Machine Learning
Jun 2

Consistent Diffusion Language Models

arXiv:2605. 00161v2 Announce Type: replace Abstract: Diffusion language models (DLMs) are an attractive alternative to autoregressive models because they promise sublinear-time, parallel generation, yet practical gains remain elusive as high-quality samples still demand hundreds of refinement steps.

By Hasan Amin, Yuan Gao, Yaser Souri, Subhojit Som, Ming Yin, Rajiv Khanna, Xia Song