arXiv:2603. 06741v2 Announce Type: replace-cross Abstract: Training frontier-scale diffusion models often requires substantial computational resources concentrated in tightly-coupled clusters, limiting participation to well-resourced institutions.
By Zhiying Jiang, Raihan Seraj, Marcos Villagra, Bidhan Roy
arXiv:2607. 24665v1 Announce Type: cross Abstract: Modern large language models scale successfully by pairing capacity growth with efficiency, keeping per-token and deployment costs under control as capacity grows.
By Yanhao Jia, Jiepeng Wang, Haibin Huang, Chi Zhang, Erik Cambria, Xuelong Li
The paper introduces techniques for efficient on-device diffusion-based image generation on consumer GPUs. It presents an embedding translator that reduces weight and latency by mapping a small text encoder into a larger encoder space, a reproducible sweep recipe for balancing speed, quality, and memory, and an interactive editor that achieves sub‑second time‑to‑first‑image on recent GPUs. These contributions aim to broaden the reach of diffusion pipelines to a wide range of client devices.
By Frieder Ganz, Maximilian M\"uller
The paper introduces Abra, a family of flow‑matching transformers used to systematically study scaling laws for text‑to‑image diffusion models across three orders of magnitude in compute. It finds that diffusion models scale predictably like language models but need far more data, with compute optimality occurring at roughly 200 image tokens per parameter—ten times the optimal ratio for large language models. The study also shows that diffusion models are robust to overtraining, that more data is preferable to larger models, and that scaling predictability extends to generative quality, optimal CFG settings, representation quality, and training curve shapes.
By Kyle Chickering, Wei-An Lin, Swayam Bhanded, Dan Saunders, Akshat Tripathi, Jiaming Song, Shyamal Buch, Xinchen Yan
arXiv:2607. 22696v1 Announce Type: cross Abstract: High-resolution video diffusion models built on Diffusion Transformers (DiTs) deliver strong fidelity but quickly exhaust the memory budget of a single workstation.
By Jiacheng Liu, Jason Liu
arXiv:2406. 14429v4 Announce Type: replace-cross Abstract: In the landscape of generative artificial intelligence, diffusion-based models have emerged as a promising method for generating synthetic images.
By Simeon Allmendinger, Domenique Zipperling, Lukas Struppek, Niklas K\"uhl
arXiv:2506. 01260v2 Announce Type: replace Abstract: Scaling models has led to significant advancements in deep learning, but training these models in decentralized settings remains challenging due to communication bottlenecks.
By Sameera Ramasinghe, Thalaiyasingam Ajanthan, Gil Avraham, Yan Zuo, Alexander Long
arXiv:2605. 26632v3 Announce Type: replace Abstract: Diffusion Transformers (DiT) achieve strong performance in image generation but incur substantial inference costs.
By Xing Cong, Hanlin Tang, Kan Liu, Tao Lan, Lin Qu, Chenhao Xie
arXiv:2605. 26632v2 Announce Type: replace Abstract: Diffusion Transformers (DiT) achieve strong performance in image generation but incur substantial inference costs.
By Xing Cong, Hanlin Tang, Kan Liu, Lan Tao, Lin Qu, Chenhao Xie
arXiv:2509.04719v3 Announce Type: replace-cross
Abstract: The widespread adoption of diffusion models for image generation necessitates efficient parallel inference to manage their substantial comput...
By Han Liang, Jiahui Zhou, Zicheng Zhou, Xiaoxi Zhang, Xu Chen
arXiv:2607. 12121v1 Announce Type: cross Abstract: Diffusion models have become the central backbone for modern image, video, and audio generation, but their efficient service remains a challenge.
By Yaqi Qiao, Ping He, Songrun Xie, Ayush Barik, Chensong Zhang, Zhengzhong Tu, Fan Lai
Reinforcement learning (RL) has become a dominant post-training paradigm, driving the emergence of high-performance RL systems such as veRL for autoregressive large language models (LLMs). In parallel, diffusion-oriented RL algorithms, e.