The paper introduces HoliDivEvolve, a holistic strategy for maintaining diversity in LLM-guided evolutionary search. It employs diverse initialization, trajectory‑adaptive island selection, and growth‑adaptive migration to ensure distinct search directions and effective knowledge sharing across islands. Experiments on varied benchmarks demonstrate competitive performance and provide controlled analyses of the design choices.
Evo-B&B is a new evolutionary framework that jointly evolves branching and node selection policies for Mixed-Integer Linear Programming (MILP) using large language model guidance and end-to-end SCIP solving feedback. It introduces a behavior-aware multi-island mechanism that measures policy similarity based on branching and node-selection behaviors to preserve population diversity and reduce redundant evaluations. Experiments on four standard MILP benchmarks show that Evo-B&B achieves competitive solving performance, generalizes to larger instances, and that joint evolution and behavior-aware diversity management are effective.
By Jiayu Chen, Chentong Chen, Yuhan Liu, Ye Fan, Jianyong Sun, Jialong Shi
TurboEvolve is a multi‑island evolutionary framework that enhances LLM‑driven program evolution by improving sample efficiency and stability within fixed API‑cost budgets. It introduces Verbalized Sampling to generate multiple diverse candidates in a single LLM call, an adaptive scheduler that adjusts the number of offspring based on progress, and island‑aware initialization that clusters seed programs and mixes subpopulations with elitist preservation. The authors also provide a reusable cross‑task solution‑pool dataset and demonstrate that TurboEvolve achieves better cost‑quality trade‑offs and more stable performance on mathematical discovery and GPU‑kernel optimization tasks compared to controlled baselines.
By Yang Yang, Zining Zhong, Jindong Li, Jiemin Wu, Kaishen Yuan, Wenshuo Chen, Menglin Yang, Yutao Yue
The paper introduces EMO-STA, a two‑stage evolutionary multi‑task optimization framework for large‑language‑model (LLM) guided program discovery. First, it evolves a shared archive of executable programs across a family of related tasks; then it adapts selected shared candidates to each target task using strategies such as warm‑starting, best‑average, or best‑per‑task adaptation. Experiments on eight diverse task families show that EMO‑STA outperforms single‑task evolution under matched budgets, with balanced shared and adaptation budgets yielding the best results and shared evolution helping to reduce overfitting in low‑evidence scenarios.
By Halil Alperen Gozeten, Xuechen Zhang, Emrullah Ildiz, Ege Onur Taga, Tara Javidi, Samet Oymak
arXiv:2608. 05651v1 Announce Type: cross Abstract: Large language model (LLM)-driven evolution has shown promise for program search and algorithm discovery, but relying on strong models throughout long evolutionary runs is costly.
By Sichun Luo, Yi Huang, Guanzhi Deng, Haibo Wang, Haochen Luo, Lei Li, Zefa Hu, Junlan Feng, Qi Liu
The paper introduces TOPOFE, a framework that treats automatic feature engineering for tabular data as a graph-structured multi-island evolutionary search. Each island explores a semantically coherent family of transformations using LLM-guided mutation and crossover, while a Prompt Adaptation Memory steers proposals based on accept/reject feedback. TOPOFE dynamically learns a directed topology graph to coordinate cross-island transfer, enabling the discovery of compositional feature programs that outperform state‑of‑the‑art methods on 29 datasets and produce lower redundancy and higher representational coverage.
By Sha Li, Naren Ramakrishnan