Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
For Your Eyes Only: Evaluating Coordination Between Isolated Language Model Instances explores whether a language model can embed a signal in natural language that another independent instance can detect without shared memory or coordination training. The study introduces a cooperative signalling game where a Sender describes two words, one hidden, and a Receiver must identify the target. Seven contemporary models from four architectural families were tested on 300 word pairs, revealing that most struggle to coordinate when signals must be undetectable, though one frontier model performs near-perfectly even after filtering, and that models can also use this capability for deliberate misdirection.
arXiv:2608. 11676v1 Announce Type: new Abstract: Heterogeneous multi-agent LLM systems, where agents are powered by different model families, can outperform homogeneous configurations by reducing redundant reasoning patterns.
The paper introduces XKV, a latent protocol that enables efficient communication between heterogeneous language models by translating a sharer's key‑value cache into a receiver's context. XKV overcomes limitations of prior methods by jointly pooling both caches, reconciling differing layer depths, and allowing each receiver position to retrieve its own residual in native KV geometry. Across 45 dataset‑model pairings, XKV outperforms previous protocols and text communication while using fewer parameters and achieving faster translation times.
ToM2Vec introduces continuous theory-of-mind tokens that enable large language model agents to reason about multiple possible partner states in multi‑agent settings. By training these tokens to abstract partner thoughts, the model generates latent representations that condition agents’ thoughts and actions, improving performance across collaborative, competitive, and mixed‑motive environments. The approach demonstrates that latent reasoning outperforms text‑based reasoning and generalizes to unseen partner models, with tokens encoding partner beliefs, desires, and next actions.
arXiv:2610.33495v1 Announce Type: new Abstract: Combining language models is usually done by averaging weights, which works only when the models share a common starting point. We ask whether five fro...
arXiv:2610.28366v1 Announce Type: new Abstract: Independently trained autoregressive language models often acquire similar capabilities, but it remains unclear whether their internal representations...