arXiv Computation and Language

Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection

arXiv Computation and Language
Oct 1

You're Hired: Strategic Model Selection for LLM Collaboration

arXiv:2609.38816v1 Announce Type: new Abstract: While multi-agent and model collaboration algorithms gain traction to combine the strengths of diverse Large Language Models (LLMs), existing systems r...

By Zongwan Cao, Ziyuan Yang, Shangbin Feng, Michael Duan, Skyler Hallinan, Bingbing Wen, Lucy Lu Wang, Yulia Tsvetkov
arXiv AI
Jun 17

Algorithmic Prompt Generation for Diverse Human-like Teaming and Communication with Large Language Models

arXiv:2504. 03991v2 Announce Type: replace-cross Abstract: Understanding how humans collaborate and communicate in teams is essential for improving human-agent teaming and AI-assisted decision-making.

By Siddharth Srikanth, Varun Bhatt, Boshen Zhang, Werner Hager, Charles Michael Lewis, Katia P. Sycara, Aaquib Tabrez, Stefanos Nikolaidis
arXiv Computation and Language
Nov 5

TandemBench: Benchmarking Decision Models for Multi-Agent Collaboration

TandemBench is a new benchmark comprising 1,200 multi‑agent cooking scenarios designed to test decision models’ ability to select optimal team plans and judge the optimality of provided options. The dataset gives models full global information and candidate plans, with reference answers derived from execution and exact search. Evaluation of 40 native decision models and 10 general‑purpose language models shows that while the best native model reaches 62.50% accuracy, many models still struggle to correctly assess whether the supplied options contain an optimal arrangement.

By Baohang Li, Xiaocheng Feng, Bing Qin