arXiv Machine Learning By Jisung Hwang, Minhyuk Sung

Gradient Preconditioning for Efficient and Reliable Reward-Guided Generation

Read the original on arXiv Machine Learning →

arXiv:2602. 08646v3 Announce Type: replace Abstract: We propose a gradient preconditioning method that makes reward-guided generation with one-step generative models both efficient and reliable.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
2d ago

Manifold-Constrained Initial Noise Optimization for Efficient Generative Model Alignment

The paper introduces ZeNOVA, a gradient‑free method for aligning initial noise in generative models. It uses annealed soft‑value guidance, manifold‑constrained hyperspherical Langevin dynamics, and Metropolis‑Hastings jumps to address instability in black‑box reward settings. Experiments on image and video models show ZeNOVA outperforms existing zeroth‑order baselines by more stably optimizing noise toward higher rewards.

By Jinho Chang, Jong Chul Ye