Beyond Perfect Teammates: Multi-Agent Collaboration with Unreliable Colleagues
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2609.21423v1 Announce Type: new Abstract: Online agent deployments produce abundant execution traces, while task-specific verification and expert annotation are costly to scale. We study how to...
arXiv:2607. 05775v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly evaluated on their ability to use tools, plan multi-step tasks, coordinate with other agents, and operate over extended horizons.
Large language model (LLM) agents are increasingly evaluated on their ability to use tools, plan multi-step tasks, coordinate with other agents, and operate over extended horizons. Reported benchmark gains often obscure recurring failure modes documented across otherwise unrelated evaluation efforts.
Kolab is a new dataset comprising over 115 hours of screen recordings from 50 professionals across 40 occupations who collaborate with AI agents on realistic, long‑horizon tasks. The dataset includes participants’ judgments of collaboration quality and output, revealing varied coordination patterns and the need for agents to anticipate how experts will use or modify their contributions. Analysis shows current state‑of‑the‑art models overestimate collaboration success and struggle to differentiate high‑ from low‑quality interactions, indicating a gap in understanding long‑horizon human‑agent teamwork.
arXiv:2610.18780v1 Announce Type: new Abstract: Large language model multi-agent systems extend individual agents' capabilities through collaboration across specialized roles, tools, and workflows. Y...
arXiv:2608. 14380v1 Announce Type: new Abstract: Many real-world tasks require LLM agents to interact with their environments over long execution horizons.