arXiv AI

Synthesizing Feature Extractors: An Agentic Approach for Algorithm Selection

The paper introduces an automated method that employs Large Language Models in a check–fix–verify loop to generate executable Python scripts for extracting problem-specific features from constraint satisfaction problems. Given a MiniZinc model and instance, the LLM agent produces code that builds a typed graph representation and computes structural properties such as graph density, variable clustering, and constraint tightness. Evaluated on vehicle routing, car sequencing, and fixed‑length error‑correcting codes, the synthesized extractors enable algorithm selectors that outperform expert‑curated mzn2feat features and transformer‑based trans2feat variants, while remaining interpretable.

arXiv AI
Aug 11

Improving Constraint Models with LLM Agents

arXiv:2608. 08127v1 Announce Type: new Abstract: The runtime of Constraint Programming (CP) solvers is highly sensitive to modeling choices, such as symmetry breaking, implied constraints, global constraints, constraint reformulation, and variable representation.

By Florentina Voboril, Stefan Szeider
arXiv AI
Aug 13

Behavior and Representation in Open-Weight Large Language Models for Combinatorial Optimization: From Feature Extraction to Algorithm Selection

arXiv:2512. 13374v2 Announce Type: replace Abstract: Recent advances in Large Language Models (LLMs) open new perspectives for automation in optimization, yet little is known about whether their internal representations capture problem structure or algorithmic behavior.

By Francesca Da Ros, Luca Di Gaspero, Kevin Roitero
arXiv AI
Sep 3

OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation

OptSkills is an archetype‑centric agent that learns and reasons about optimization problems using large language models. It clusters problems by underlying archetypes, explores diverse modeling and solver configurations within each cluster, and distills successful trajectories into reusable workflow‑level skills. The system achieves state‑of‑the‑art accuracy on multiple datasets, outperforming prior methods on challenging benchmarks such as MIPLIB‑NL and OOD NLCO.

By Haochen Yang, Ke Zhao, Mengyuan Ma, Xingyu Lu, Xiangfeng Wang, Hong Qian
arXiv AI
Aug 5

IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulation

arXiv:2608. 02641v1 Announce Type: cross Abstract: Large language models (LLMs) can translate natural-language optimization problems into solver-ready formulations, but direct code generation is brittle: schema, indexing, and semantic errors can cause compilation failures, infeasible models, or incorrect objectives, while iterative repair, search, and multi-agent workflows increase inference cost.

By Penglin Zhu, Linhai Zhang, Jungang Xu, Xinchi Wei, Xiuqi Wu