Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly.
The paper introduces Flow-Based Distribution Matching (FBDM), a non‑adversarial method that learns self‑supervised representations by aligning images to explicit geometric references through spherical conditional velocity regression. By using an ETF‑inspired reference, FBDM allows more reference components than the flow dimension while maintaining geometric separation, and it incorporates an alignment loss to bring augmented views closer together. Experiments on datasets from CIFAR to ImageNet show that FBDM performs nearly as well as adversarial distribution‑matching methods, achieves a 1.48‑ to 1.83‑fold speedup, and offers a theoretical bound on downstream misclassification rates.
Pixel diffusion models generate RGB images directly but tend to miss fine‑scale natural‑image statistics. The authors introduce an adversarial post‑training step that adds an adversarial loss to the model’s output at non‑high‑noise timesteps, without changing the architecture or sampling procedure. This approach improves distribution fidelity, coverage, prompt alignment, and perceptual quality across two pixel backbones, and restores missing high‑frequency spectral power while avoiding memorization or mode dropping.
By Xin Lin, Zhifei Zhang, Yuqian Zhou, Haitian Zheng, Zhe Lin, Ming-Hsuan Yang, Truong Nguyen
The paper introduces Flow-Based Distribution Matching (FBDM), a non‑adversarial framework that learns self‑supervised representations using explicit geometric references and spherical conditional velocity regression. FBDM assigns augmented image views to shared target references while limiting reference usage, and employs an alignment loss to bring view representations closer. Experiments on datasets from CIFAR to ImageNet demonstrate that FBDM performs nearly as well as adversarial DM, outperforms existing SSL methods, and achieves a 1.48‑ to 1.83‑fold speedup with minimal GPU memory increase, while a theoretical analysis bounds downstream misclassification rates in terms of the pretraining loss.
By Yuling Jiao, Wensen Ma, Houduo Qi, Defeng Sun
arXiv:2608. 14038v1 Announce Type: new Abstract: Modern text-to-image diffusion models rely on classifier-free guidance (CFG) to achieve high image fidelity and text alignment.
By Ashwini Pokle, Alexandre Galashov, Arnaud Doucet, Mauricio Delbracio, Valentin De Bortoli
arXiv:2505. 04486v4 Announce Type: replace-cross Abstract: Flow matching models have shown great potential in image generation tasks among probabilistic generative models.
By Anirban Samaddar, Yixuan Sun, Viktor Nilsson, Sandeep Madireddy