arXiv Machine Learning By Julian Soltes

Hyperellipsoid Density Sampling: Exploitative Sequences to Accelerate High-Dimensional Optimization

Read the original on arXiv Machine Learning →

arXiv:2511. 07836v4 Announce Type: replace-cross Abstract: The curse of dimensionality remains a persistent challenge in modern optimization problems.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 18

Search at the Cost of Sampling: Nearly-Instant Latent Space Bayesian Optimization

The paper introduces a new Bayesian optimization approach tailored for generative models used in de novo discovery pipelines. By employing a linear surrogate model constrained to a spherical domain—where high‑dimensional latent vectors naturally concentrate—the authors derive nearly closed‑form solutions for both surrogate modeling and acquisition, achieving at least a 100‑fold speedup over existing methods. This acceleration enables Bayesian optimization to be used as a practical drop‑in component in pipelines that previously found it too slow to consider.

By Donney Fan, Colin Doumont, Aleksandra Kalisz, Paul Duckworth, Jacob R. Gardner, Henry Moss, Geoff Pleiss
arXiv AI
Jul 13

LLM-Driven Evolutionary Generation of Multi-Objective Bayesian Optimization Algorithms

arXiv:2607. 08791v1 Announce Type: cross Abstract: Designing effective multi-objective Bayesian optimization (MOBO) algorithms requires balancing many interdependent design choices whose optimal configuration is problem-dependent and typically demands deep expertise.

By Georgios Laskaris, Reuben Brasher, Niki van Stein, Elena Raponi, Thomas B\"ack, Florian Neukart
arXiv Machine Learning
Aug 27

Gradient-based Sample Selection for Faster Bayesian Optimization

The paper introduces Gradient-based Sample Selection Bayesian Optimization (GSSBO), a method that builds the Gaussian process surrogate on a strategically chosen subset of samples rather than the full dataset. By using gradient information to eliminate redundant points while keeping diversity and representativeness, GSSBO achieves sublinear regret bounds and reduces the cubic computational cost of standard BO. Experiments on synthetic and real-world tasks show that this approach maintains comparable optimization performance while significantly cutting GP fitting time and resource usage.

By Qiyu Wei, Haowei Wang, Zirui Cao, Songhao Wang, Richard Allmendinger, Mauricio A \'Alvarez