arXiv AI By Jianxin Gao, Tianyi Yu, Linna Deng, Runze Li, Zining Wang

Testing Interchangeability in LLM Agent Teams

Read the original on arXiv AI →

The study examines whether agents in multi‑agent systems can be swapped without affecting performance, assuming interchangeability. Eight independently formed teams of agents were created from a single base model, and agents were traded between teams while tracking task scores and communication efficiency. Swapping agents had minimal impact on task scores but increased communication costs by 16–63 % and revealed that agents are more interchangeable in outcomes than in coordination, with larger effects after longer formation histories.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 26

Interchangeable in Role, Not in History: Replacing Members of Formed LLM Teams

The study examines how swapping members in large‑language‑model (LLM) teams affects performance. By replacing a team member with a newcomer who either carries the original team’s written notebook, a notebook from another team, or no notebook, the authors find that newcomers with the original notebook often outperform those without it in cooperative tasks such as cooking, wildfire response, and medical Q&A. However, when compared to the original team, these replacements consistently underperform and require more messages per unit of progress, with the deficit persisting across model families and decoding temperatures and narrowing only when planning‑only members are added.

By Jianxin Gao, Runze Li, Tianyi Yu, Liangwei Ren, Bohan Chen, Zining Wang
arXiv AI
Oct 2

Worse Together: How Performance Breaks Down in Multi-User Multi-Agent Teams

The paper investigates how coordination among AI agents serving different users degrades performance compared to a single coordinating agent. Across five advanced models and 77 scenarios in four shared-resource environments—API key budgets, clinic calendars, personal assistant bookings, and merge queues—the study finds that multi‑agent teams consistently underperform, sometimes collapsing entirely, and that even with communication channels coordination overhead remains significant. The authors identify specific failure modes such as stalling, action overriding, and claim fabrication, and propose environment‑specific mitigations like team leads and procedural instructions, while releasing the MAMUBench benchmark for future research.

By Sahan Paliskara, Nattaput Namchittai, Andrew Lampinen
arXiv AI
Oct 7

Verifying Coordination in Parallel Coding Agents: NP-Bench and a Scheduling Planner

The paper introduces NP‑Bench, a benchmark and a proactive scheduling planner that coordinates parallel large‑language‑model coding agents. By partitioning work scopes and ordering merges ahead of time, the planner improves clean‑integration rates from 1/9 to 9/9 and eliminates merge conflicts, outperforming both no‑coordination and reactive‑detection baselines. It also demonstrates that cross‑session memory can eliminate repeated mistakes and that routing facts to agents does not improve long‑context accuracy at scale.

By Sumanyu Muku
arXiv AI
Jul 29

Toward an Organizational Science of Multi-Agent LLM Systems: Decoupling Who, How, and Which Algorithm

arXiv:2607. 25446v1 Announce Type: new Abstract: Multi-agent frameworks built on large language models (LLMs) routinely entangle three logically distinct concerns: who is on the team (organization), how members align (coordination), and which algorithm fuses their work (collaboration protocol).

By Huan Chen, Xiang Song, Jian Jin, Pan Ren, Liang-Jie Zhang