Benchmarks and evaluation

Leaderboards, eval harnesses and ablations — the contested business of deciding which model is actually better.

28,322 stories · RSS feed

arXiv AI
Sep 15

BusMA: A Bus Communication Substrate for Multi-Agent Systems

BusMA introduces a bus-based communication substrate for multi‑agent systems, enabling any agent to address others through a shared channel. The framework includes agent registration, message routing, and shared memory management, and defines four communication intents—discussion, challenge, guidance, and request for explanation—to facilitate fine‑grained interaction. Experiments with two leading LLMs on 13 tasks in visual reasoning, mathematical reasoning, and knowledge retrieval show that BusMA consistently outperforms existing hierarchical manager‑worker and router‑based message passing methods.

By Yanwen Peng, Delvin Ce Zhang, Xi Wang, Nikolaos Aletras
arXiv AI
Sep 15

LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents

arXiv:2609.13287v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive f...

By Zhangxuan Gu, Haoxing Chen, Qi Qin, Yi Xin, Kai Gan, Lin Liu, Long Cui, Xiaomei Wang, Beitong Zhou, Yunzhu Zhang, Zhengwen Zeng, Changlong Gao, Weizhi Chen, Rongchao Zhang, Haoyuan Wu, Shuheng Shen, Changhua Meng, Weiqiang Wang, Jianguo Li, Zhenzhong Lan