arXiv Machine Learning

Autoregressive Differentiable Method for Integer Programming

arXiv Machine Learning
Oct 3

Reformulation-Contrastive Learning for Mixed Integer Programs

The paper introduces ReMILP, a reformulation‑contrastive learning framework that uses self‑supervision from equivalent formulations of mixed‑integer linear programs (MILPs). By distinguishing re‑descriptions and substitutions, the method trains a graph neural network and a hypernetwork to predict how variable embeddings transform under changes of variables, achieving invariance and equivariance without solver‑derived labels. The learned representations prove useful for tasks such as binary solution, constraint activity, and integrality gap prediction, and serve as a strong initialization for fine‑tuning.

By Ousema Bouaneni, Mathis Le Bail, Cl\'ement Elliker, Ma\"el Jenny, Sonia Vanier
Hugging Face Trending Papers
Aug 20

Learning Early-to-Final Solution Consistency for MILP Acceleration

Mixed-Integer Linear Programming (MILP) is a fundamental problem class in operations research and combinatorial optimization, with broad applications to industrial decision-making. Owing to their NP-hardness, however, modern solvers may struggle to find high-quality solutions for challenging MILP instances within practical time limits.

arXiv AI
Aug 28

CG4AI: A Column Generation Framework for Training AI Models Under Constraints

CG4AI is a column generation framework that trains AI models while enforcing linear constraints on their outputs. It constructs a convex combination of models, using a master linear program to set mixture weights and a pricing subproblem to generate new models guided by dual variables, focusing on the most violated constraints. The method is applied to MNIST digit classification—demonstrating constraint learning, adversarial robustness, error correction, and output relabeling—and to multi‑commodity flow routing, achieving feasible predictors with higher accuracy than single‑model baselines.

By Youcef Magnouche, Abderrahmane Driouch, S\'ebastien Martin, Pierre Bauguion
arXiv Machine Learning
Jun 15

Neural Slack Variables for Shape Constraints

arXiv:2606. 13803v1 Announce Type: new Abstract: Enforcing functional inequality constraints such as monotonicity and convexity in neural networks is a fundamental challenge in many industrial and scientific applications.

By Ruben Wiedemann, Antoine Jacquier, Lukas Gonon
arXiv Machine Learning
Sep 17

Mixed-Integer Nonlinear Differentiable Predictive Control for Underground Pumped Hydro Energy Storage Systems

The paper extends Mixed-Integer Differentiable Predictive Control (MI‑DPC) to handle multi‑modal discrete decisions and nonconvex polynomial dynamics in Underground Pumped Hydro Energy Storage Systems (UPHES). It introduces a neural policy that maps problem parameters to continuous setpoints and integer mode selections using a Gumbel‑Softmax layer, trained via self‑supervised differentiation of the finite‑horizon control objective. Key methodological advances include a parallel differentiable simulator, a Transformer encoder for long‑range temporal dependencies, and a Gumbel‑Softmax temperature annealing schedule, enabling the framework to achieve only 1.6% suboptimality compared to a mixed‑integer quadratic programming baseline while providing a five‑order‑of‑magnitude speedup in online scheduling.

By Honghui Zheng, J\'an Boldock\'y, Yury Dvorkin, J\'an Drgo\v{n}a