arXiv Computer Vision

Elastic Token Compression for Pixel-Space Diffusion Transformers

arXiv AI
Jun 15

HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing

arXiv:2606. 13898v1 Announce Type: cross Abstract: Creative image editing tools, such as Photoshop's Remove or Generative Fill buttons, are central to everyday customer use and account for a major share of traffic in Photoshop and Lightroom.

By Haoran You, Yotam Nitzan, Lingzhi Zhang, Yifan Gong, Mang-Tik Chiu, Connelly Barnes, Yan Kang, Yuqian Zhou, Eli Shechtman, Sohrab Amirghodsi
arXiv Machine Learning
Aug 19

Abra: Scaling Diffusion Image Training

The paper introduces Abra, a family of flow‑matching transformers used to systematically study scaling laws for text‑to‑image diffusion models across three orders of magnitude in compute. It finds that diffusion models scale predictably like language models but need far more data, with compute optimality occurring at roughly 200 image tokens per parameter—ten times the optimal ratio for large language models. The study also shows that diffusion models are robust to overtraining, that more data is preferable to larger models, and that scaling predictability extends to generative quality, optimal CFG settings, representation quality, and training curve shapes.

By Kyle Chickering, Wei-An Lin, Swayam Bhanded, Dan Saunders, Akshat Tripathi, Jiaming Song, Shyamal Buch, Xinchen Yan