Hugging Face Trending Papers
Jul 7

From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models

Large-scale text-to-image models are attractive backbones for dense prediction because RGB generation pretraining learns rich semantic, structural, and geometric priors. Existing generative and editing approaches reuse these priors by casting dense prediction as target generation: annotations such as depth, normals, alpha mattes, masks, and heatmaps are encoded into an RGB-trained VAE latent space and decoded back as image-like targets.

arXiv AI
Sep 10

DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space

DC-Gen is a post‑training framework that accelerates text‑to‑image diffusion models by using a deeply compressed latent space. It first aligns the base model’s latent representations with a lightweight embedding alignment, then applies minimal LoRA fine‑tuning to preserve generation quality. Experiments on SANA and FLUX.1‑Krea show that DC‑Gen‑FLUX cuts 4K image generation latency by 53× on an NVIDIA H100 and, with NVFP4 SVDQuant, achieves a 138× total speedup on a single NVIDIA 5090 GPU.

By Wenkun He, Yuchao Gu, Junyu Chen, Dongyun Zou, Yujun Lin, Zhekai Zhang, Haocheng Xi, Muyang Li, Ligeng Zhu, Jincheng Yu, Junsong Chen, Enze Xie, Song Han, Han Cai