arXiv AI By Rafa{\l} Stachowiak, Tomasz P. Pawlak

MPMMine: Better Benchmarks for Constraint Acquisition

Read the original on arXiv AI →

MPMMine introduces a comprehensive benchmark suite for Constraint Acquisition (CA) in Mathematical Programming, addressing shortcomings of existing datasets such as inconsistent formats and limited problem classes. The suite offers standardized, extensible artifacts—including multiple model formulations, numerous parameter instantiations, and thousands of solutions and non‑solutions across discrete, continuous, and mixed domains—alongside natural‑language descriptions for text‑to‑model methods. Accompanying tools, the mpmmine‑py API and an interactive leaderboard, enable consistent evaluation of CA algorithms within isolated containers.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 11

Improving Constraint Models with LLM Agents

arXiv:2608. 08127v1 Announce Type: new Abstract: The runtime of Constraint Programming (CP) solvers is highly sensitive to modeling choices, such as symmetry breaking, implied constraints, global constraints, constraint reformulation, and variable representation.

By Florentina Voboril, Stefan Szeider
arXiv Machine Learning
Oct 8

Accelerating Floating-Point Satisfiability Solving via Gradient Normalization

GradSAT is a new framework that improves satisfiability solving for Quantifier-Free Floating-Point formulas by treating each SMT clause as an independent multi‑task learning problem. It uses dynamic gradient normalization (GradNorm) to balance gradient magnitudes across clauses, preventing a few difficult clauses from dominating the optimization trajectory. The approach combines a GPU‑accelerated PyTorch backend for continuous relaxation with a precise local search engine, yielding a robust, highly parallelizable solver.

By Yuanzhuo Zhang
arXiv Computation and Language
Sep 22

CCTU: A Benchmark for Tool Use under Complex Constraints

CCTU is a new benchmark designed to evaluate large language models (LLMs) on their ability to use tools under complex constraints. It includes 200 test cases that average seven constraint types and 4,700‑token prompts, covering resource, behavior, toolset, and response dimensions. An executable validation module performs step‑level checks, and nine state‑of‑the‑art LLMs were tested, revealing that none exceed a 20% task completion rate when strict constraints are enforced, with frequent violations and limited self‑refinement.

By Junjie Ye, Guoqiang Zhang, Wenjie Fu, Zelin Li, Tao Gui, Qi Zhang, Xuanjing Huang
arXiv AI
Aug 5

IR2Solve: Structured Intermediate Representations for Cost-Efficient Optimization Autoformulation

arXiv:2608. 02641v1 Announce Type: cross Abstract: Large language models (LLMs) can translate natural-language optimization problems into solver-ready formulations, but direct code generation is brittle: schema, indexing, and semantic errors can cause compilation failures, infeasible models, or incorrect objectives, while iterative repair, search, and multi-agent workflows increase inference cost.

By Penglin Zhu, Linhai Zhang, Jungang Xu, Xinchi Wei, Xiuqi Wu
arXiv Machine Learning
Jun 9

OpenCompass: A Universal Evaluation Platform for Large Language Models

arXiv:2605. 19276v3 Announce Type: replace-cross Abstract: In recent years, the field of artificial intelligence has undergone a paradigm shift from task-specific small-scale models to general-purpose large language models (LLMs).

By Maosong Cao, Kai Chen, Haodong Duan, Yixiao Fang, Zhiwei Fei, Tong Gao, Ge Jiaye, Mo Li, Hongwei Liu, Junnan Liu, Yuan Liu, Chengqi Lyu, Han Lyu, Ningsheng Ma, Zerun Ma, Yu Sun, Zhiyong Wu, Linchen Xiao, Zhuozhi Xiong, Jun Xu, Haochen Ye, Zhaohui Yu, Yike Yuan, Songyang Zhang, Yufeng Zhao, Fengzhe Zhou, Peiheng Zhou, Dongsheng Zhu, Lin Zhu, Jingming Zhuo