arXiv Computer Vision

DICE: Distilling Classifier-Free Guidance into Text Embeddings

arXiv Computer Vision
Sep 3

GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors

GlyphAnchor is a new method that improves visual text rendering in image generation and editing models by adding lightweight glyph patch conditions anchored to the target image’s positional encoding. The approach is trained with staged supervised finetuning and text-aware post‑training, and it works with both text‑to‑image and image‑editing diffusion transformers. Experiments on various backbones and the newly introduced InfoTextBench benchmark show that GlyphAnchor consistently enhances text fidelity while maintaining overall image quality, especially for long, complex, or densely arranged text and rare characters.

By Qiang Xiang, Shuang Sun, Binglei Li, Yibo Chen, Xu Tang, Yao Hu, Junping Zhang
arXiv AI
Sep 10

DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space

DC-Gen is a post‑training framework that accelerates text‑to‑image diffusion models by using a deeply compressed latent space. It first aligns the base model’s latent representations with a lightweight embedding alignment, then applies minimal LoRA fine‑tuning to preserve generation quality. Experiments on SANA and FLUX.1‑Krea show that DC‑Gen‑FLUX cuts 4K image generation latency by 53× on an NVIDIA H100 and, with NVFP4 SVDQuant, achieves a 138× total speedup on a single NVIDIA 5090 GPU.

By Wenkun He, Yuchao Gu, Junyu Chen, Dongyun Zou, Yujun Lin, Zhekai Zhang, Haocheng Xi, Muyang Li, Ligeng Zhu, Jincheng Yu, Junsong Chen, Enze Xie, Song Han, Han Cai
arXiv Computation and Language
Aug 28

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models

Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models introduces the VIG‑Sampler, a method that prioritizes tokens for decoding based on their attention to image tokens and penalizes redundancy in image‑attention distributions. The approach aims to improve the quality of multimodal generation by selecting more informative tokens during diffusion decoding. Experiments on seven captioning and VQA benchmarks with three open‑source dMLLMs show that VIG‑Sampler outperforms the Info‑Gain Sampler by an average of 19.3 CIDEr points and achieves better COCO Caption results using only half as many decoding steps.

By Insu Lee, Wooje Park, Wonseok Shin, Jinwoo Son, Byonghyo Shim