arXiv Machine Learning By Travis Zhang, Christian Belardi, Justin Lovelace, Jin Peng Zhou, Saebyeol Shin, Carla P. Gomes, Kilian Q. Weinberger

Optimize Your Sampling: Tuned Diffusion Sampling with Bayesian Optimization

Read the original on arXiv Machine Learning →

The paper introduces Optimizing Your Sampling (OYS), a method that treats diffusion model timestep selection as a black-box optimization problem and uses Bayesian optimization to directly improve the target metric. OYS outperforms default schedules and the Align Your Steps approach on text-to-image generation, inpainting, and other image tasks, as shown by both quantitative and human evaluations. It works without additional training, applies to distilled models, and enhances both simple and sophisticated samplers, achieving 89–94% of a 50‑step schedule’s quality with only 5 steps and a tenfold reduction in inference cost.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Jul 26

Learning Sampling Parameters for Diffusion Models

Text-to-image diffusion models expose many inference-time sampling parameters, including prompts, negative prompts, classifier-free guidance scales, and noise schedules. These parameters are typically manually chosen once and then held fixed across prompts and denoising timesteps, even though different prompts and stages of generation can benefit from different parameter values.

arXiv Machine Learning
1d ago

Learned End-to-End Guidance Schedules for Diffusion Models

The paper introduces Learned End-to-End Guidance Schedules (LEEGS) for diffusion models, which train a time‑dependent guidance schedule to balance data quality and requirement satisfaction while reducing sampling steps. LEEGS minimizes the guidance function over a small set of examples using stochastic gradient descent and employs a gradient approximation to cut training time by a factor of four. Experiments on tasks such as image inpainting, noisy image inverse problems, face‑ID‑guided generation, and PDE problems show that LEEGS outperforms baselines at the same computational budget or matches constant guidance with only 10% of the steps.

By Aneesh Barthakur, Mathias Niepert, Luiz F. O. Chamon