arXiv Machine Learning
Learning Noise Optimization for Reward Alignment in Few-Step Generative Models
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Oct 16
Noise-Space Reward Alignment for Few-Step Generative Models
The paper introduces Noise Policy Optimization (NPO), a method for aligning few-step generative models with black-box reward signals. NPO learns an amortized flow policy that transforms initial Gaussian noise into a reward-tilted distribution, allowing the pretrained generator to produce higher-reward outputs without fine-tuning. The approach achieves superior reward-quality trade-offs across image, language, and protein generation tasks while drastically reducing inference cost compared to test-time search methods.
arXiv AI
Jul 7
Trust-Region Noise Search for Black-Box Alignment of Diffusion and Flow Models
arXiv:2603. 14504v2 Announce Type: replace-cross Abstract: Optimizing the noise samples of diffusion and flow models is an increasingly popular approach to align these models to target rewards at inference time.
arXiv AI
Oct 2
Manifold-Constrained Initial Noise Optimization for Efficient Generative Model Alignment
The paper introduces ZeNOVA, a gradient‑free method for aligning initial noise in generative models. It uses annealed soft‑value guidance, manifold‑constrained hyperspherical Langevin dynamics, and Metropolis‑Hastings jumps to address instability in black‑box reward settings. Experiments on image and video models show ZeNOVA outperforms existing zeroth‑order baselines by more stably optimizing noise toward higher rewards.
Hugging Face Trending Papers
Sep 30
Manifold-Constrained Initial Noise Optimization for Efficient Generative Model Alignment
Recent advances in distillation and flow-map models have enabled deterministic one- or few-step generation for high-quality data, facilitating a new branch of reward alignment approaches that directly...
arXiv Machine Learning
Sep 1
Reward-guided Fine-Tuning of One-Step Generative Models via Wasserstein Gradient Flow
arXiv:2608.29647v1 Announce Type: new Abstract: To mitigate the time complexity of generative models, one-step generative models have recently emerged through direct mapping from noise to data in a s...
arXiv AI
Jun 3
How to Guide Your Flow: Few-Step Alignment via Flow Map Reward Guidance
arXiv:2604. 27147v3 Announce Type: replace-cross Abstract: In generative modeling, we often wish to produce samples that maximize a user-specified reward such as aesthetic quality or alignment with human preferences, a problem known as \textit{guidance}.