arXiv AI

Efficient Text-to-Image Generation: An Adaptive Step Schedule Controller for Diffusion Models

The paper introduces an adaptive step schedule controller for text‑to‑image diffusion models, allowing the number of denoising steps to vary based on the complexity of the input prompt. By mixing step schedules of different sizes and monitoring error discrepancies at each timestep, the method switches schedules to maintain image quality while reducing inference time. Experiments on COCO and DiffusionDB demonstrate that this approach achieves faster generation without sacrificing visual fidelity.

arXiv AI
Jul 1

Finite Difference Flow Optimization for RL Post-Training of Text-to-Image Models

arXiv:2603. 12893v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt alignment.

By David McAllister, Miika Aittala, Tero Karras, Janne Hellsten, Angjoo Kanazawa, Timo Aila, Samuli Laine
arXiv Machine Learning
Aug 19

Abra: Scaling Diffusion Image Training

The paper introduces Abra, a family of flow‑matching transformers used to systematically study scaling laws for text‑to‑image diffusion models across three orders of magnitude in compute. It finds that diffusion models scale predictably like language models but need far more data, with compute optimality occurring at roughly 200 image tokens per parameter—ten times the optimal ratio for large language models. The study also shows that diffusion models are robust to overtraining, that more data is preferable to larger models, and that scaling predictability extends to generative quality, optimal CFG settings, representation quality, and training curve shapes.

By Kyle Chickering, Wei-An Lin, Swayam Bhanded, Dan Saunders, Akshat Tripathi, Jiaming Song, Shyamal Buch, Xinchen Yan