arXiv Computer Vision
3d ago

Which Tokens to Merge? Diffusion Dynamics for Efficient Image Generation

The paper introduces Dynamics-aware Token Merging (DaTMe), a training‑free method that accelerates diffusion models by selectively merging tokens based on diffusion dynamics. DaTMe builds an importance map from the Tweedie denoised estimate, combining temporal changes and structural high‑frequency content to decide which tokens to preserve and which to merge. Experiments on PixArt-a and FLUX show that DaTMe maintains visual fidelity across the entire image while reducing token computation.

By SeungJu Cha, Ye-Chan Kim, HyunGee Kim, Sungho Koh, Dong-Jin Kim
arXiv AI
Sep 2

V-Co: A Closer Look at Visual Representation Alignment via Co-Denoising

V-Co investigates visual co-denoising for pixel-space diffusion models, using a unified JiT-based framework to isolate key design choices. The study identifies two essential components: a dual-stream architecture with flexible cross-stream interaction and a perceptual-drifting hybrid loss combined with RMS-based feature rescaling for stronger semantic supervision. Experiments on ImageNet-256 demonstrate that V-Co surpasses baseline pixel-space diffusion and strong prior pixel-diffusion methods at comparable model sizes while requiring fewer training epochs.

By Han Lin, Xichen Pan, Zun Wang, Yue Zhang, Chu Wang, Jaemin Cho, Mohit Bansal