Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but greater representational capacity does not establish that the receiver uses task-relevant information. End-task performance alone also cannot reveal whether an observed effect depends on message presence, content generated for the evaluated example, or information supplied by a separate agent.
arXiv:2607. 26773v1 Announce Type: new Abstract: Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but greater representational capacity does not establish that the receiver uses task-relevant information.
arXiv:2608. 04893v1 Announce Type: cross Abstract: Multi-agent LLM systems relay key--value caches instead of text and credit their gains to exchanged ``latent thoughts''.
arXiv:2608. 11676v1 Announce Type: new Abstract: Heterogeneous multi-agent LLM systems, where agents are powered by different model families, can outperform homogeneous configurations by reducing redundant reasoning patterns.
The paper introduces Independent–Communicate–Revise (ICR), a framework that isolates communication effects in large language model multi‑agent systems by fixing initial reasoning and measuring how messages influence answer revision. ICR evaluates correction, preservation, and selectivity across four reasoning benchmarks, revealing that similar overall accuracy can mask divergent revision behaviors. The study shows that richer messages can both improve and harm outcomes, and that receiver policies can shift preservation and correction dynamics differently across tasks.
arXiv:2609.37017v1 Announce Type: new Abstract: LLM-based multi-agent systems (MAS) increasingly use latent collaboration to avoid the information loss and repeated encoding-decoding overhead of natu...
arXiv:2609.36855v1 Announce Type: new Abstract: Multi-agent LLM systems rely on message passing among specialized agents to accomplish complex tasks. However, an upstream agent may provide useful inf...
LLM-based multi-agent systems (MAS) increasingly use latent collaboration to avoid the information loss and repeated encoding-decoding overhead of natural-language communication. However, directly for...
arXiv:2511. 20639v3 Announce Type: replace-cross Abstract: Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence.
arXiv:2607. 01600v1 Announce Type: new Abstract: As large language models (LLMs) are deployed as communicating agents, does inter-agent communication cause outputs to converge?
arXiv:2607. 03598v1 Announce Type: cross Abstract: When a person shares something with a language model, the model often answers the surface of the message rather than what the sender was doing by sending it: share a finished project and it critiques the code; share a raw late-night line and it runs a wellness check.
The paper introduces REST (REpresentation‑Supervised Thoughts), a new training objective for latent recursive language‑model systems that supplements cross‑entropy loss with differentiable penalties enforcing causality, minimality, separability, and stability of internal thought representations. By applying REST to both single‑agent and multi‑agent setups without changing architectures or adding inference parameters, the authors achieve up to 7.5 percentage‑point gains in accuracy across seven diverse benchmarks and a 30 % improvement in convergence to the final answer. The method also yields more informative latent thoughts, improving interpretability of agent communication.
The paper introduces Verifiable Latent Alignments (VLA), a framework that monitors and steers hidden communication channels between language‑model agents. VLA links private latent states to public actions via event identifiers, enabling causal analysis. Experiments on a multi‑agent auction benchmark show high detection accuracy and effective mitigation of collusion, even without training on attack examples.