Hugging Face Trending Papers

Unlocking Spatial Grounding in Flow-Matching Models via SNR Tuning

arXiv Machine Learning
Oct 22

Unlocking Spatial Grounding in Flow-Matching Models via SNR Tuning

The paper shows that the signal‑to‑noise ratio (SNR) distribution is key to achieving fine‑grained spatial control in flow‑matching generative models. By training on high‑noise regimes rather than a centered SNR distribution, the authors raise layout adherence from 25.9 % to 80.8 % on a synthetic benchmark, approaching the 83.6 % ceiling of the underlying variational autoencoder. These insights also improve real‑world layout accuracy on COCO, boosting average precision from 1.0 % to 57.3 % without changing the model architecture.

By Martin Thi{\ss}en, Elke Hergenr\"other
Hugging Face Trending Papers
Jul 7

From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models

Large-scale text-to-image models are attractive backbones for dense prediction because RGB generation pretraining learns rich semantic, structural, and geometric priors. Existing generative and editing approaches reuse these priors by casting dense prediction as target generation: annotations such as depth, normals, alpha mattes, masks, and heatmaps are encoded into an RGB-trained VAE latent space and decoded back as image-like targets.

arXiv Computer Vision
Oct 12

Learning Representations to Guide Pixel Diffusion Transformers

The paper investigates how visual representations contribute to pixel diffusion transformers and finds that higher representation quality does not always improve generative performance, and that separating architecture into specialized decoders mainly redistributes modeling rather than enhancing generative suitability. Based on these findings, the authors propose Representation Guidance (RG), a method that compacts generation-relevant information into a low-dimensional bottleneck and explicitly uses it to steer decoder generation. RG achieves state‑of‑the‑art results on ImageNet 256×256 with fewer parameters, scales efficiently, and extends to text‑to‑image tasks with strong benchmark performance.

By Zihao Pan, Mengting Chen, Cheng Shi, Taihang Hu, Zhengrong Yue, Zikang Wang, Yuan Wang, Wei Li, Sibei Yang
arXiv AI
Oct 26

Representation Learning via Composite Subspace Flow Matching

The paper introduces Composite Subspace Flow Matching (CSFM), a representation learning method that minimizes variance by inverting a deterministic degradation curriculum across spectral, color, and illumination subspaces. CSFM uses hard temporal style truncation to constrain an encoder, encouraging it to ignore transient style artifacts while preserving persistent content. Experiments on CIFAR-10, CIFAR-100, and STL-10 demonstrate that CSFM achieves competitive discriminative transferability and generative synthesis, outperforming standard optimal transport flows in linear probing and few‑shot classification while maintaining a smooth latent space.

By Jos\'e Afonso, M\'ario Figueiredo
Hugging Face Trending Papers
Aug 6

Energy-Guided Flow Matching

Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly.