Hugging Face Trending Papers

NAGO: Noise-Aware Generative Operator via Flow Matching

arXiv Machine Learning
Sep 17

Beyond Random Couplings: Contrastive Noise Alignment in Generative Flows

The paper introduces Contrastive Noise Alignment (CNA), a training-time method for generative flow models that dynamically aligns Gaussian noise with data samples using a cross-modal InfoNCE objective. By modeling noise as an interacting particle system and regularizing with angular entropy and radial norm penalties, CNA reduces arbitrary data-noise couplings and flow curvature. Empirical results show that CNA improves generation quality, lowering FID by over 50% for few-step pixel-space generation compared to standard rectified flow and outperforming optimal transport baselines by at least 24%.

By Lennart Wittke, Vinicius Azevedo
arXiv Machine Learning
Aug 19

Composing Flow-Matching Energies with Known Physics: Generation, OOD Detection, and Inversion on PDE Fields

The paper presents a method that combines flow‑matching models with energy‑based modeling to explicitly construct scalar energy functions for physical fields. These energies are derived from a matching regression objective on a linear Gaussian interpolation, avoiding variational approximations or extra MCMC steps, and can be used for energy‑corrected data generation, out‑of‑distribution detection, and posterior sampling in inverse problems. The approach enables general MCMC samplers that reduce PDE residuals and spectral distance, and it demonstrates that combining data‑driven and physics‑based energies improves OOD detection accuracy.

By Yixuan Sun, Anirban Samaddar, Sandeep Madireddy
arXiv Machine Learning
Sep 11

Deep operator learning for efficient sampling from invariant measures of stochastic differential equations

The paper presents an amortized neural sampler that merges operator learning with flow-based methods to efficiently sample from invariant measures of stochastic differential equations (SDEs). By mapping SDE coefficient functions to pushforwards from a reference measure, the approach shifts the sampling cost to an initial training phase, after which new SDE instances can be sampled with a single encoder pass and a few ODE solver steps, independent of mixing time. The framework incorporates Lagrangian trajectory sensors and cross attention to handle high-dimensional problems, and the authors provide theoretical guarantees of expressivity and resolution invariance, demonstrating competitive accuracy and significant speedups over MCMC in 1D, 2D, and 64D SDE families.

By Lin Guo, Li Lei, Jingtong Zhang
arXiv Machine Learning
Jun 2

Low-Pass Flow Matching

arXiv:2606. 02177v1 Announce Type: new Abstract: Flow Matching typically relies on white noise sources, a choice often misaligned with the power spectra of natural data, which tend to decay with frequency.

By Francesco M. Ruscio, T. Konstantin Rusch