arXiv Machine Learning By Dominik Jehle, Tom Zehle

Design and Tuning of Multi-Agent Systems Using Bayesian Evolutionary Optimization

Read the original on arXiv Machine Learning →

The paper introduces a Bayesian Evolutionary Optimization framework for automatically discovering task‑specific multi‑agent system (MAS) topologies. It combines evolutionary operators that generate diverse workflow graphs with a graph‑aware Gaussian Process and Expected Improvement to guide costly evaluations toward promising candidates. Experiments on BigCodeBench for code generation and on tabular preprocessing benchmarks show that the evolved MAS architectures outperform other evaluated agent systems and improve performance on temporal datasets while remaining competitive on IID data.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 4

Evolving Excellence: Automated Optimization of LLM-based Agents

The paper introduces ARTEMIS, a no-code evolutionary optimization platform that automatically tunes large language model (LLM) agents by jointly optimizing prompts, tool descriptions, and parameters using semantically-aware genetic operators. Starting from a benchmark script and natural language goals, ARTEMIS discovers configurable components, extracts performance signals from execution logs, and evolves configurations without architectural changes. Experiments on four agent systems show significant gains: a 13.6% increase in acceptance rate for the ALE Agent, a 10.1% performance boost for the Mini‑SWE Agent, a 36.9% token‑reduction for the CrewAI Agent, and a 22% accuracy improvement for the MathTales‑Teacher Agent using a smaller open‑source model.

By Paul Brookes, Vardan Voskanyan, Rafail Giavrimis, Matthew Truscott, Mina Ilieva, Chrystalla Pavlou, Alexandru Staicu, Manal Adham, Will Evers- Hood, Jingzhi Gong, Kejia Zhang, Matvey Fedoseev, Vishal Sharma, Roman Bauer, Zheng Wang, Hema Nair, Wei Jie, Tianhua Xu, Aurora Constantin, Leslie Kanthan, Michail Basios
arXiv AI
Oct 26

TGR-EvoDAG: A DAG-based Multi-Agent Code Evolution Framework for Generative Recommendation on Tencent

TGR‑EvoDAG is a DAG‑based multi‑agent framework that automates code evolution for generative recommendation systems, addressing cost blindness and short‑sighted evaluation issues in existing recursive self‑improvement methods. It incorporates stage‑aware cost planning and active downstream co‑adaptation to manage GPU‑hour budgets and navigate temporary regressions, enabling autonomous evolution of a complete generative recommendation pipeline. Experiments on Amazon datasets and deployment on Tencent’s media platform show significant offline metric gains and a measurable increase in online click‑through rate.

By Junlin He, Junzhang Zhu, Yudong Li, Yihong Tang, Xuefeng Jiang, Wei Ma, Chengxiang Zhuo, Zang Li