arXiv AI
Sep 16

Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systems

The paper investigates how to choose model pools for Multi-Agent Systems (MAS) that combine multiple model outputs to tackle complex reasoning tasks. It evaluates eight selection strategies—such as model size, accuracy, and answer diversity—across both before-generation (routing) and after-generation (majority-voting, LLM-as-a-judge) MAS architectures on scientific benchmarks. The study finds that expanding the candidate pool often harms performance, that selecting candidates within a single model family yields the best relative gains, and that indiscriminate addition of heterogeneous models can destabilize the system.

By Sara Vera Marjanovi\'c, Jiacheng Xu, Aleksandr Laptev, Grigor Nalbandyan, Erik Arakelyan, Evelina Bakhaturina
arXiv AI
Oct 7

OOPMAS: Object-Oriented Multi-Agent Systems for Query-Level Workflow Generation

OOPMAS introduces a training‑free framework that generates both the agent set and the coordination workflow at the granularity of individual queries. Agents are defined as object‑oriented class definitions with dedicated roles, tools, and persistent state, while workflows are expressed as executable main functions over these agent objects. A dynamic skill library accumulates structured lessons from execution feedback across optimization rounds, enabling in‑context improvement without any gradient updates or fine‑tuning, and achieves 89.6% accuracy on a mixed‑task benchmark, outperforming the strongest baseline by 18.1 percentage points.

By Qi Cheng, Shengyu Chen, Wei Cheng, Yiqun Xie, Xiaowei Jia, Haoyu Wang, Haifeng Chen
arXiv AI
Oct 16

Bias Control and Injection for Multi-Agent Aggregation

The paper introduces a test-time aggregation framework for multi-agent reasoning with large language models. It mitigates non-semantic biases by normalizing reasoning traces and injects bias to create decision instability, which signals reliability. The method improves accuracy and token efficiency on several mathematical reasoning benchmarks without requiring validation data or prior model strength knowledge.

By Sungjae Lee, Soheil Abbasloo, Jabin Koo, Jungseul Ok
arXiv Computation and Language
Oct 1

You're Hired: Strategic Model Selection for LLM Collaboration

arXiv:2609.38816v1 Announce Type: new Abstract: While multi-agent and model collaboration algorithms gain traction to combine the strengths of diverse Large Language Models (LLMs), existing systems r...

By Zongwan Cao, Ziyuan Yang, Shangbin Feng, Michael Duan, Skyler Hallinan, Bingbing Wen, Lucy Lu Wang, Yulia Tsvetkov