arXiv AI

End-to-End Differentiable Diffusion Conditioning for Physics-Informed Optimization

The paper introduces Differentiable Diffusion Conditioning (D2C), an offline model‑based optimization approach that turns a frozen conditional diffusion model into a gradient‑based optimizer. By making the reverse denoising chain differentiable with respect to conditioning signals, D2C optimizes conditioning variables using gradients from surrogate objectives and physics‑informed penalties. The method is evaluated on laser pulse optimization for inertial confinement fusion, sustainable data‑center workload scheduling, and four Design‑Bench tasks, achieving top results on the real‑world tasks and the best average rank across the benchmarks.

arXiv Machine Learning
Oct 5

Learn Feasibility Once, Optimize All Objectives: Derivative-Free Diffusion Models for Chance-Constrained Programming

The paper introduces D$^3$Opt, a derivative‑free diffusion‑based framework that separates constraint modeling from objective optimization in chance‑constrained programs. It learns a risk‑conditioned diffusion model once on constraint‑filtered decisions, then uses an annealed, particle‑based Feynman–Kac correction to optimize any post‑specified objective without retraining. The method is proven to preserve feasibility and provides an error bound, and experiments show effective optimization across smooth, non‑smooth, and non‑convex objectives, including objective transfer tasks.

By Ziwen Liu, Yan Liu, Congying Han, Tiande Guo, Yao Yan, Weichen Zhao
arXiv Machine Learning
Oct 9

Exploiting Gradients in Bayesian Inference of Expensive Simulators

The paper explores how to use gradients of simulator outputs with respect to input parameters to improve Bayesian inference for expensive simulators. By incorporating gradient information into Gaussian process surrogate models, the authors show that Bayesian optimization can converge faster under a limited simulation budget. They find that reverse‑mode differentiation yields efficiency gains, while forward‑mode does not offset its computational cost, especially when the number of parameters exceeds the output dimensionality.

By \v{S}imon Sold\'at, V\'aclav \v{S}m\'idl
arXiv Computer Vision
Oct 2

Principled Design of Diffusion-based Optimizers for Inverse Problems

Score‑based diffusion models excel at inverse problems but suffer from slow inference and task‑specific hyperparameter tuning. This paper introduces principled reparameterizations that create invariances, enabling the reuse of the same hyperparameters across different tasks. Building on the RED‑diff framework, the authors present OptDiff, a streamlined pipeline that integrates convex optimization to accelerate inference, achieving notable speedups and higher image quality in reconstruction, deblurring, and super‑resolution experiments.

By Julio Oscanoa, Irmak Sivgin, Cagan Alkan, Daniel Ennis, John Pauly, Mert Pilanci, Shreyas Vasanawala