arXiv Machine Learning By Pekka Malo, Lauri Viitasaari, Patrik Nummi, Antti Suominen, Ankur Sinha, Olli Tahvonen

Operator Calculus for Population-Based Optimization: A Mean-Field Convergence Theory

Read the original on arXiv Machine Learning →

arXiv:2606. 14289v1 Announce Type: cross Abstract: Population-based and distributional optimization methods, from evolution strategies and consensus-based optimization to covariance-matrix adaptation and stochastic gradient methods viewed as distributional dynamics, are widely used for nonconvex or black-box problems, yet their convergence analyses remain fragmented across algorithm-specific techniques.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 5

Operator Calculus for Population-Based Optimization: Modular Convergence and Finite-Population Guarantees

The paper introduces an operator calculus for population-based optimization, treating each update rule—such as mutation, selection, or recombination—as an operator. By establishing explicit regularity and small‑step conditions, the authors show that the leading effects of these operators add, allowing convergence guarantees to be reused as modular building blocks. The framework differentiates between finding and retaining good solutions, reducing the population’s mean objective, and concentrating candidates near an optimizer, and it identifies additional approximation conditions required for finite‑budget guarantees. Applications to distribution adaptation, recombinative evolution, and consensus dynamics are verified, including nonconvex cases, and controlled experiments illustrate how component effects vary with population geometry and performance measures.

By Pekka Malo, Lauri Viitasaari, Patrik Nummi, Antti Suominen, Ankur Sinha, Olli Tahvonen
arXiv Machine Learning
Oct 9

Randomized Transport Maps for Model-Free Policy-Gradient Mean-Field Control

The paper introduces Transport REINFORCE, a model‑free policy‑gradient method for discrete‑time mean‑field control that captures both the dynamics and population‑distribution effects of a policy. It perturbs the population distribution—directly on the simplex for finite state spaces and via a Gaussian‑mixture transport map for continuous spaces—to estimate the missing mean‑field contribution. The authors prove consistency of the perturbed objective and gradient, provide bias and mean‑square error bounds, and demonstrate improved performance over standard REINFORCE on several benchmarks.

By Adonis Jamal, Samy Mekkaoui, Yadh Hafsi, Huy\^en Pham
arXiv Machine Learning
Jul 3

Adjoint Matching through the Lens of the Stochastic Maximum Principle in Optimal Control

arXiv:2604. 08580v2 Announce Type: replace-cross Abstract: Reward fine-tuning of diffusion and flow models and sampling from tilted or Boltzmann distributions can both be formulated as stochastic optimal control (SOC) problems, where learning an optimal generative dynamics corresponds to optimizing a control under SDE constraints.

By Carles Domingo-Enrich, Jiequn Han