Large language models

Model releases, architecture work and prompting research on large language models — from frontier-lab announcements to the arXiv papers behind them.

32,584 stories · RSS feed

arXiv AI
Sep 15

BusMA: A Bus Communication Substrate for Multi-Agent Systems

BusMA introduces a bus-based communication substrate for multi‑agent systems, enabling any agent to address others through a shared channel. The framework includes agent registration, message routing, and shared memory management, and defines four communication intents—discussion, challenge, guidance, and request for explanation—to facilitate fine‑grained interaction. Experiments with two leading LLMs on 13 tasks in visual reasoning, mathematical reasoning, and knowledge retrieval show that BusMA consistently outperforms existing hierarchical manager‑worker and router‑based message passing methods.

By Yanwen Peng, Delvin Ce Zhang, Xi Wang, Nikolaos Aletras
arXiv Computation and Language
Sep 15

How Contrastive Decoding Enhances Large Audio Language Models

The paper evaluates four Contrastive Decoding (CD) strategies for Large Audio Language Models (LALMs) and finds that Audio-Aware Decoding and Audio Contrastive Decoding are the most effective. Their performance varies across models, largely depending on the baseline error profile: CD reliably fixes errors where models incorrectly claim no audio or rely on uncertainty-driven guessing, but struggles with flawed reasoning or confident misassertions. A token-level analysis shows that CD’s suppression targets hesitation markers, explaining its limited impact on confident errors.

By Tzu-Quan Lin, Wei-Ping Huang, Yi-Cheng Lin, Hung-yi Lee
arXiv AI
Sep 15

LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents

arXiv:2609.13287v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) achieve high decoding efficiency through block-parallel, arbitrary-order generation, making them attractive f...

By Zhangxuan Gu, Haoxing Chen, Qi Qin, Yi Xin, Kai Gan, Lin Liu, Long Cui, Xiaomei Wang, Beitong Zhou, Yunzhu Zhang, Zhengwen Zeng, Changlong Gao, Weizhi Chen, Rongchao Zhang, Haoyuan Wu, Shuheng Shen, Changhua Meng, Weiqiang Wang, Jianguo Li, Zhenzhong Lan