arXiv Machine Learning By Martin Thi{\ss}en, Elke Hergenr\"other

Unlocking Spatial Grounding in Flow-Matching Models via SNR Tuning

Read the original on arXiv Machine Learning →

The paper shows that the signal‑to‑noise ratio (SNR) distribution is key to achieving fine‑grained spatial control in flow‑matching generative models. By training on high‑noise regimes rather than a centered SNR distribution, the authors raise layout adherence from 25.9 % to 80.8 % on a synthetic benchmark, approaching the 83.6 % ceiling of the underlying variational autoencoder. These insights also improve real‑world layout accuracy on COCO, boosting average precision from 1.0 % to 57.3 % without changing the model architecture.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Jul 7

From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models

Large-scale text-to-image models are attractive backbones for dense prediction because RGB generation pretraining learns rich semantic, structural, and geometric priors. Existing generative and editing approaches reuse these priors by casting dense prediction as target generation: annotations such as depth, normals, alpha mattes, masks, and heatmaps are encoded into an RGB-trained VAE latent space and decoded back as image-like targets.