arXiv Machine Learning By Pekka Malo, Lauri Viitasaari, Patrik Nummi, Antti Suominen, Ankur Sinha, Olli Tahvonen

Operator Calculus for Population-Based Optimization: Modular Convergence and Finite-Population Guarantees

Read the original on arXiv Machine Learning →

The paper introduces an operator calculus for population-based optimization, treating each update rule—such as mutation, selection, or recombination—as an operator. By establishing explicit regularity and small‑step conditions, the authors show that the leading effects of these operators add, allowing convergence guarantees to be reused as modular building blocks. The framework differentiates between finding and retaining good solutions, reducing the population’s mean objective, and concentrating candidates near an optimizer, and it identifies additional approximation conditions required for finite‑budget guarantees. Applications to distribution adaptation, recombinative evolution, and consensus dynamics are verified, including nonconvex cases, and controlled experiments illustrate how component effects vary with population geometry and performance measures.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jun 15

Operator Calculus for Population-Based Optimization: A Mean-Field Convergence Theory

arXiv:2606. 14289v1 Announce Type: cross Abstract: Population-based and distributional optimization methods, from evolution strategies and consensus-based optimization to covariance-matrix adaptation and stochastic gradient methods viewed as distributional dynamics, are widely used for nonconvex or black-box problems, yet their convergence analyses remain fragmented across algorithm-specific techniques.

By Pekka Malo, Lauri Viitasaari, Patrik Nummi, Antti Suominen, Ankur Sinha, Olli Tahvonen
arXiv AI
Sep 28

Genetic Algorithms with Optimization Guided Operators

The paper introduces a new framework for genetic algorithms where mutation and recombination operators are guided by machine‑learning optimization rather than random changes. It shows that such operators can improve objective values but at higher computational cost, and demonstrates three key phenomena: the necessity of solution‑pool diversity for parity learning, the simultaneous need for generation, mutation, and recombination to achieve near‑optimal solutions, and a phase transition in Gaussian settings where positive drift yields exponential speedup.

By Anna Brandenberger, Ilan Doron-Arad, Elchanan Mossel