arXiv Machine Learning
Oct 22

Unlocking Spatial Grounding in Flow-Matching Models via SNR Tuning

The paper shows that the signal‑to‑noise ratio (SNR) distribution is key to achieving fine‑grained spatial control in flow‑matching generative models. By training on high‑noise regimes rather than a centered SNR distribution, the authors raise layout adherence from 25.9 % to 80.8 % on a synthetic benchmark, approaching the 83.6 % ceiling of the underlying variational autoencoder. These insights also improve real‑world layout accuracy on COCO, boosting average precision from 1.0 % to 57.3 % without changing the model architecture.

By Martin Thi{\ss}en, Elke Hergenr\"other
Hugging Face Trending Papers
Jul 7

From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models

Large-scale text-to-image models are attractive backbones for dense prediction because RGB generation pretraining learns rich semantic, structural, and geometric priors. Existing generative and editing approaches reuse these priors by casting dense prediction as target generation: annotations such as depth, normals, alpha mattes, masks, and heatmaps are encoded into an RGB-trained VAE latent space and decoded back as image-like targets.