arXiv AI

Agreement Before Diversity: Verification-First Complementarity for Heterogeneous Language-Model Coordination

arXiv:2608. 04618v1 Announce Type: new Abstract: Heterogeneous language-model ensembles expand the space of candidate responses, yet they lack a principled criterion for when a newly generated answer should supersede an already supported one.

arXiv AI
Sep 3

Public-Sharing Labels and Verbatim Field Egress in an MCP-to-A2A Agent Configuration: A Controlled Multi-Model Study

The study evaluates safety properties of a controlled MCP-to-A2A agent configuration by measuring verbatim field egress across ten record scenarios under three labeling conditions (CONFIDENTIAL, no header, PUBLIC – OK TO SHARE). Using four models repeated four times each, 480 trials were conducted, and the results show that adding a PUBLIC header is descriptively linked to higher verbatim egress, with the effect varying strongly by model. The study releases code, byte‑pinned traces, and an offline analysis pipeline as a public artifact.

By Arpan Kumar Mahapatra
arXiv AI
Sep 1

Decomposing Wrong-Consensus Agreement in LLM Self-Consistency

The paper investigates the nature of agreement among repeated samples of large language models (LLMs), showing that strong agreement can arise even for incorrect answers. It introduces a pluralistic agreement index, Gamma, which is decomposed into a mechanical component driven solely by per‑case answer preferences and a residual component that captures preference‑unexplained agreement. Experiments on GPT‑4.1 and several open‑weight models demonstrate that mechanical agreement dominates in many settings, while the residual varies with benchmark type and sampling protocol.

By Lizhuo Zhang, Mengmeng Tang, Chenfeng Long, Xiaoyong Tang, Xiang Luo
arXiv AI
Aug 25

XTC: Head-Aware Sampling by Excluding Top Choices

XTC (Exclude Top Choices) is a lightweight, head‑aware decoding operator that improves diversity in autoregressive language models by removing overly probable tokens that dominate the next‑token distribution. It works by identifying tokens above a plausibility threshold, probabilistically excluding the dominant choices, and renormalizing the remaining distribution. Across 60 experiments on models such as Gemma 3 and DeepSeek R1, XTC boosts Distinct‑2 scores by 11–15 % and cuts repeat trigrams by 27–47 %, while a Mechanical Turk study shows a 62.3 % preference for XTC‑generated text without loss of fluency.

By Philipp Emanuel Weidmann, Allen Roush, Judah Goldfeder, Sanjay Basu, Ravid Shwartz-Ziv