arXiv Machine Learning

Decision-Driven Regularization: A Blended Model for Learning and Optimization

arXiv:2608. 15124v1 Announce Type: new Abstract: In contextual optimization, the decision-maker seeks optimal decisions to minimize a cost function, that varies based on observed features.

arXiv Machine Learning
Sep 21

Decision-Focused Learning for Mean-Variance Portfolio Optimization via KKT-Based Reformulation

The paper introduces a decision‑focused learning framework for mean‑variance portfolio optimization that embeds the Karush‑Kuhn‑Tucker optimality conditions of the lower‑level optimization into a single‑level learning problem. This approach preserves budget and short‑sale constraints while remaining tractable for standard nonlinear solvers. Experiments on real‑world ETF data across two asset universes demonstrate superior performance on multiple investment metrics and highlight the benefits of the proposed regularization.

By Kensei Nosaka, Shunnosuke Ikeda, Yuichi Takano
arXiv Machine Learning
Jul 27

Smart predict-then-robustly-optimize

arXiv:2607. 21773v1 Announce Type: new Abstract: In this paper, we propose and study a robust variant of the smart predict-then-optimize approach that accounts for prediction shifts due to disturbance in the covariate feature space.

By Aakil Caunhye, Xuefei Lu, Belen Martin-Barragan
arXiv Machine Learning
Jun 18

BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training

arXiv:2606. 18650v1 Announce Type: new Abstract: As Large Language Model (LLM) datasets scale to trillions of tokens, data selection has emerged as a critical frontier to filter out uninformative noise and construct adaptive learning trajectories.

By Jiaxing Wang, Deping Xiang, Jin Xu, Zirui Liu, Zicheng Zhang, Guoqiang Gong, Jun Fang, Chao Liu, Pengzhang Liu, Tongxuan Liu, Ke Zhang, Qixia Jiang
arXiv Machine Learning
4d ago

Introducing the CZAR Loss: A Tailored Objective Function for Financial Log-Return Predictions

arXiv:2609.36061v1 Announce Type: new Abstract: In quantitative finance, standard regression losses are misaligned with the economics of return prediction. As the conditional mean of financial log-re...

By Joel Pfeffer (Allora Foundation), J. M. Diederik Kruijssen (Allora Foundation), Florian Stecker (Allora Foundation), Steven N. Longmore (Allora Foundation, LJMU)
arXiv Statistics ML
Sep 11

Learning-Based Surrogate Method for Stochastic Optimization under Decision-Dependent Uncertainty with Adaptive Random Designs

The paper introduces a learning-based surrogate approach for stochastic optimization problems where uncertainty depends on the decision, modeled via a nonparametric regression. It constructs a surrogate that embeds iteratively updated Jacobian estimates, using an adaptive random design that focuses sampling near the current iterate to achieve dimension‑independent convergence of the Jacobian estimates. The resulting learning‑based stochastic prox‑linear (L‑SPL) algorithm demonstrates nonasymptotic convergence rates and outperforms existing methods in sample efficiency and objective value in numerical experiments.

By Boyang Shen, Junyi Liu