arXiv AI

Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learning

arXiv:2307. 05213v3 Announce Type: replace-cross Abstract: Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.

arXiv Statistics ML
Sep 11

Learning-Based Surrogate Method for Stochastic Optimization under Decision-Dependent Uncertainty with Adaptive Random Designs

The paper introduces a learning-based surrogate approach for stochastic optimization problems where uncertainty depends on the decision, modeled via a nonparametric regression. It constructs a surrogate that embeds iteratively updated Jacobian estimates, using an adaptive random design that focuses sampling near the current iterate to achieve dimension‑independent convergence of the Jacobian estimates. The resulting learning‑based stochastic prox‑linear (L‑SPL) algorithm demonstrates nonasymptotic convergence rates and outperforms existing methods in sample efficiency and objective value in numerical experiments.

By Boyang Shen, Junyi Liu
arXiv Machine Learning
Sep 18

Sufficient Decision Proxies for Decision-Focused Learning

The paper explores when different decision proxies are appropriate for decision‑focused learning (DFL) in optimization problems with uncertainty. It identifies problem properties that justify using a particular proxy and proposes alternative proxies that maintain learning complexity. Experiments on continuous, discrete, and objective‑ or constraint‑uncertain problems demonstrate the effectiveness of these approaches.

By Noah Schutte, Grigorii Veviurko, Krzysztof Postek, Neil Yorke-Smith