arXiv Machine Learning By Zhiying Jiang, Raihan Seraj, Marcos Villagra, Bidhan Roy

Paris: A Decentralized Trained Open-Weight Diffusion Model

Read the original on arXiv Machine Learning →

arXiv:2510. 03434v3 Announce Type: replace-cross Abstract: We present Paris, the first publicly released diffusion model pre-trained entirely through decentralized computation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 2

Heterogeneous Decentralized Diffusion Models

arXiv:2603. 06741v2 Announce Type: replace-cross Abstract: Training frontier-scale diffusion models often requires substantial computational resources concentrated in tightly-coupled clusters, limiting participation to well-resourced institutions.

By Zhiying Jiang, Raihan Seraj, Marcos Villagra, Bidhan Roy
arXiv Machine Learning
Sep 21

The Weight Is Over - Interactive Diffusion on Consumer GPUs

The paper introduces techniques for efficient on-device diffusion-based image generation on consumer GPUs. It presents an embedding translator that reduces weight and latency by mapping a small text encoder into a larger encoder space, a reproducible sweep recipe for balancing speed, quality, and memory, and an interactive editor that achieves sub‑second time‑to‑first‑image on recent GPUs. These contributions aim to broaden the reach of diffusion pipelines to a wide range of client devices.

By Frieder Ganz, Maximilian M\"uller
arXiv Machine Learning
Aug 19

Abra: Scaling Diffusion Image Training

The paper introduces Abra, a family of flow‑matching transformers used to systematically study scaling laws for text‑to‑image diffusion models across three orders of magnitude in compute. It finds that diffusion models scale predictably like language models but need far more data, with compute optimality occurring at roughly 200 image tokens per parameter—ten times the optimal ratio for large language models. The study also shows that diffusion models are robust to overtraining, that more data is preferable to larger models, and that scaling predictability extends to generative quality, optimal CFG settings, representation quality, and training curve shapes.

By Kyle Chickering, Wei-An Lin, Swayam Bhanded, Dan Saunders, Akshat Tripathi, Jiaming Song, Shyamal Buch, Xinchen Yan
arXiv AI
Aug 5

CollaFuse: Collaborative Diffusion Models

arXiv:2406. 14429v4 Announce Type: replace-cross Abstract: In the landscape of generative artificial intelligence, diffusion-based models have emerged as a promising method for generating synthetic images.

By Simeon Allmendinger, Domenique Zipperling, Lukas Struppek, Niklas K\"uhl