arXiv AI By Bruno Veloso, Jo\~ao Gama

Constrained Hyperparameter Optimization for Streaming Data

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Machine Learning
Sep 21

Bilevel Optimization of Topology and Hyperparameters (BOTH)

The paper introduces BOTH, a method that differentiates topology optimization (TO) itself to compute hypergradients for tuning hyperparameters alongside the primary design optimization. By evaluating only one or two TO steps, the approach provides sufficient information and scales to thousands of hyperparameters with a cost comparable to a few standard TO runs. Experiments on stress‑constrained and compliance problems, including a neural‑parameterized density field, demonstrate the effectiveness of this joint optimization strategy.

By Suryanarayanan Manoj Sanu, Miguel Anibal Bessa, Alejandro Marcos Arag\'on
arXiv Machine Learning
Sep 16

Learning efficient representations of complex constraints for scalable optimization

The paper introduces PolyFormer, a physics-informed machine learning framework that learns compact polytopic representations of complex constraints. By transforming constraint-induced geometry into efficient polytopic reformulations, PolyFormer reduces optimization complexity and enables the use of standard solvers. Evaluations on large‑scale resource aggregation, network‑constrained optimization, and uncertainty‑aware optimization show up to 6,400‑fold speedups and 99.87% memory savings while keeping feasibility and objective errors low.

By Yilin Wen, Yi Guo, Bo Zhao, Wei Qi, Zechun Hu, Colin Jones, Jian Sun