arXiv AI By Ziqiao Wang, Yang You

Beyond the Estimate: Wiener-Informed Decoding for Easier Training of Pixel-Space Flow Models

Read the original on arXiv AI →

The paper introduces Wiener-informed Decoding (WiD), a method that leverages frozen Wiener estimates and statistical knowledge to improve the training of pixel-space flow models. By integrating a trainable Wiener prediction path with coefficient interfaces that inject features into the native decoder, WiD accelerates training, enhances generation quality, and yields smoother gradient trajectories across various model scales and decoder architectures. Experiments on ImageNet 256×256 show that PixelDiT-XL with WiD achieves an FID of 1.53 after 500 epochs, matching the quality of the baseline while requiring 37.5% fewer training epochs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 19

Rethinking the design space of Vanilla Pixel Diffusion Transformers

The paper revisits pixel-space diffusion models, showing that a vanilla diffusion transformer can generate directly in pixel space by swapping velocity prediction for clean image prediction. It introduces MFlow, an adaptive parameterization that interpolates between these two prediction modes based on data representation and model capacity, and demonstrates competitive performance on ImageNet, UCF‑101, and text‑to‑image tasks. Additionally, the authors add ConvRefiner, a lightweight convolutional module trained post‑hoc to restore high‑frequency details while preserving FID.

By Soumik Mukhopadhyay, Long Mai, Abhinav Shrivastava, Aniruddha Mahapatra
Hugging Face Trending Papers
Aug 6

Energy-Guided Flow Matching

Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly.