The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The paper investigates how visual representations contribute to pixel diffusion transformers and finds that higher representation quality does not always improve generative performance, and that separating architecture into specialized decoders mainly redistributes modeling rather than enhancing generative suitability. Based on these findings, the authors propose Representation Guidance (RG), a method that compacts generation-relevant information into a low-dimensional bottleneck and explicitly uses it to steer decoder generation. RG achieves state‑of‑the‑art results on ImageNet 256×256 with fewer parameters, scales efficiently, and extends to text‑to‑image tasks with strong benchmark performance.
AlignMorph is a tuning‑free diffusion framework for image morphing that separates geometric alignment from generative denoising. It uses Global Semantic Transport—entropic optimal transport and reliability‑aware latent warping—to achieve diffusion‑compatible semantic alignment, and Coordinate‑Aligned Generation—symmetric bi‑phase attention handoff—to preserve spatial coordinates during denoising. The method eliminates ghosting and delivers superior structural coherence and temporal smoothness on morphing benchmarks without any per‑pair optimization.
PixelMoE introduces a pixel-space generative framework that applies LLM-style Mixture-of-Experts (MoE) to diffusion models, enabling sparse scaling of model capacity without diffusion-specific routing. The approach combines Token-Choice routing, fine-grained routed experts, a shared expert, and bias-based load balancing, while also employing Pixel-Space Hierarchical Flow Matching to adjust spatial resolution during denoising. PixelMoE outperforms dense counterparts at comparable active parameter counts, achieving strong FID scores on class-conditional ImageNet-1K.
The paper investigates why Diffusion Transformers perform well when predicting clean data but poorly when predicting noise or velocity. It introduces the concept of *residual-stream burden*, explaining that noisy targets force the residual stream to carry noise-dependent variation through the network, limiting representation flexibility. Experiments show that spectral concentration of clean targets reduces this burden, and the authors propose Spatially Indexed Hyper-Connections (SiHC) to expand residual bandwidth, achieving state‑of‑the‑art FID on ImageNet.
arXiv:2608.29997v1 Announce Type: new Abstract: We propose Discrete Diffusion Bridges (DDB), a novel framework designed to resolve the fundamental spatiotemporal misalignment of standard discrete dif...
arXiv:2609.24919v1 Announce Type: new Abstract: Recent advances in pixel-space diffusion models have narrowed the image quality gap with latent-space diffusion, but still converge more slowly and lag...