arXiv Machine Learning By Yilin Wen, Yi Guo, Bo Zhao, Wei Qi, Zechun Hu, Colin Jones, Jian Sun

Learning efficient representations of complex constraints for scalable optimization

Read the original on arXiv Machine Learning →

The paper introduces PolyFormer, a physics-informed machine learning framework that learns compact polytopic representations of complex constraints. By transforming constraint-induced geometry into efficient polytopic reformulations, PolyFormer reduces optimization complexity and enables the use of standard solvers. Evaluations on large‑scale resource aggregation, network‑constrained optimization, and uncertainty‑aware optimization show up to 6,400‑fold speedups and 99.87% memory savings while keeping feasibility and objective errors low.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 8

ORACLE: Optimizer-Relative Alignment for Constrained LEarning

The paper introduces ORACLE, a method for constrained learning that evaluates constraint compatibility after the optimizer has taken a step, rather than before. ORACLE performs a joint endpoint linearization of diverse constraint families, constructs an alignment in the optimizer’s geometry, bounds its authority, and commits the adjustment only after validation. Experiments on eight PDE benchmarks with four different optimizers show that ORACLE matches or improves performance in 94% of configurations, outperforming other constraint-handling approaches.

By Utkarsh Grover, Wyatt Mackey, Kaixun Hua, J. Morris Chang, Xiaomin Lin
arXiv Machine Learning
Oct 28

Constraint Learning by Optimizing over Trained Neural Networks: A Pragmatic Tutorial

The article "Constraint Learning by Optimizing over Trained Neural Networks: A Pragmatic Tutorial" discusses the emerging paradigm of embedding trained machine learning models, particularly neural networks, into optimization problems. It explains how constraints can be learned from data or objectives approximated to simplify models, while addressing challenges of size and speed. The tutorial offers practical guidance and demonstrates benefits through a case study that shows smaller, sparser networks can improve efficiency.

By Jiaxiao Fang, Thiago Serra
arXiv AI
Jun 12

PolyFlow: Safe and Efficient Polytope-Constrained Flow Matching with Constraint Embedding and Projection-free Update

arXiv:2606. 13400v1 Announce Type: cross Abstract: While flow-based generative models have demonstrated strong performance across a wide range of domains, deploying them in safety-critical physical systems remains challenging due to strict constraint requirements.

By Jianming Ma, Qiyue Yang, Yang Zhang, Liyun Yan, Zhanxiang Cao, Yazhou Zhang, Yue Gao
arXiv Machine Learning
Oct 12

A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition

The paper presents a scalable learned iterative solver for nonlinear model predictive control (NMPC) that removes dependence on the prediction horizon by exploiting temporal decomposition in the network architecture. It introduces a closed‑loop resampling strategy to align training with deployment, achieving up to four‑fold speedups over IPOPT while maintaining comparable control performance and avoiding constraint violations. The method outperforms the previous monolithic LISCO approach on a CSTR cascade benchmark, scaling to larger problems without increasing network size.

By Lukas L\"uken, Sergio Lucia