arXiv AI October 23, 2026 By Alan-Barsag Gazzaev, Alexey Gavrilov, Sergey Muravyov, Ilya Makarov

Hidden Messages Between Diffusion Language Model Agents: Causal Evidence for Latent Communication

The paper investigates whether diffusion language model agents can exchange hidden messages via their continuous denoising states. By compressing a sender’s state into four dense vectors, the receiver can incorporate this information while preserving its own context. Experiments on tasks such as Tiny-A2D, Dream-7B, and QASC show that removing or substituting the message significantly degrades performance, and that a single late transfer can outperform multiple exchanges.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers

Jul 29

Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM

Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but greater representational capacity does not establish that the receiver uses task-relevant information. End-task performance alone also cannot reveal whether an observed effect depends on message presence, content generated for the evaluated example, or information supplied by a separate agent.

llms agents

arXiv AI

Jul 31

Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM

arXiv:2607. 26773v1 Announce Type: new Abstract: Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but greater representational capacity does not establish that the receiver uses task-relevant information.

By Huixiang Zhang, Mahzabeen Emu

llms agents

arXiv AI

Jul 20

Induction in Both Directions: A Mechanistic Analysis of In-Context Learning in Masked Diffusion Language Models

arXiv:2607. 15893v1 Announce Type: cross Abstract: While the internal mechanisms of autoregressive (AR) transformers have been studied extensively, much less is known about diffusion language models (DLMs), an emerging alternative that generates text by iterative denoising.

By Andy Catruna, Emilian Radoi

llms rag diffusion

arXiv Computation and Language

Oct 22

A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse

arXiv:2602.02133v3 Announce Type: replace-cross Abstract: Autoregressive language models (ARMs) suffer from the reversal curse: after learning ''$A$ is $B$,'' they often fail on the reverse query ''$...

By Moongyu Jeon, Sangwoo Shin, BumJun Kim, Kyelim Lee, Albert No

llms diffusion

arXiv Computation and Language

Oct 15

Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models

arXiv:2610.19696v1 Announce Type: new Abstract: Multi-agent systems allow language models to solve tasks collaboratively by sharing complementary information. These systems typically communicate thro...

By Xin Li, Mengbing Liu, Hao Jiang, Xin Gao, Annan Wang, Xingwei Qu, Yichi Zhang, Chau Yuen

llms agents fine-tuning

arXiv AI

Oct 1

Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents

arXiv:2609.38536v1 Announce Type: cross Abstract: Diffusion-based large language models (dLLMs) promise to break the sequential latency bottleneck of autoregressive agents through parallel decoding,...

By Jiacheng Qiu, Christopher E. Mower, Jan Peters, Haitham Bou-Ammar, Matthieu Zimmer

llms agents diffusion robotics benchmarks

One email a morning, machine-written

Related stories

Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM

Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM

Induction in Both Directions: A Mechanistic Analysis of In-Context Learning in Masked Diffusion Language Models

A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse

Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models

Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents