arXiv AI By Run Peng, Ziqiao Ma, Amy Pang, Sikai Li, Zhang Xi-Jia, Yingzhuo Yu, Cristian-Paul Bara, Joyce Chai

Communication and Verification in LLM Agents towards Collaboration under Information Asymmetry

Read the original on arXiv AI →

The paper investigates how Large Language Model (LLM) agents can collaborate on a shared task under information asymmetry, using a table‑top version of Einstein Puzzles. It introduces a fine‑tuning‑plus‑verifier framework that equips agents with communication strategies and environmental verification signals. Results show that aligned communication is crucial for rule understanding and human trust, while a verifier improves task comprehension and promotes safer, interpretable collaboration.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Oct 15

Narrowing the Collaboration Gap, Probably

arXiv:2610.19215v1 Announce Type: new Abstract: Large language models are increasingly deployed as teams of agents that hold different private information about a shared task. How should such agents...

By Mirah Shi, Marcel Hussing, Ira Globus-Harris, Natalie Collina, Aaron Roth, Surbhi Goel
arXiv AI
Nov 5

MASBench: Benchmarking LLM-based Multi-Agent Collaboration under Partial Observability

MASBench is a benchmark for evaluating large language model (LLM)-based multi‑agent systems (MAS) under partial observability, a realistic constraint where agents only see limited environmental information. The benchmark is structured into three progressive task categories—Reasoning, Scheduling, and Game—and assesses three collaboration mechanisms: Protocol, Memory, and Routing. It provides deterministic evaluation metrics such as performance score, communication cost, and cost effectiveness, and includes empirical results across various LLM backbones to guide effective MAS design.

By Qizhi Chu, Zekai Yu, Sijie Wen, Yang Liu, Chen Qian, Cheng Yang, Chuan Shi, Zhiyuan Liu