arXiv AI
A latent dimension of Condorcet's jury theorem for multiple AI advisers
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 10
When LLMs Agree, Are They Right? Auditing Self-Consistency and Cross-Model Agreement as Confidence Signals
arXiv:2607. 08065v1 Announce Type: new Abstract: LLM-as-judge (Zheng et al.
arXiv AI
Sep 10
A Layered Analysis of Disagreement And Answer Quality in Multi-Agent LLM Debate
arXiv:2609.08016v1 Announce Type: new Abstract: Multi-agent debate, in which several LLMs exchange arguments before answering, is widely assumed to improve answer quality by surfacing genuine disagre...
arXiv AI
Sep 23
Agreement Overstates Evidence: Error Dependence in LLM Judge Consensus
arXiv:2609.22512v1 Announce Type: new Abstract: Consensus among LLM judges is often taken as strong evidence that a decision is correct. This assumes that judges make their errors independently. In p...
arXiv Computation and Language
Oct 19
Same Person, Different Advice: Auditing LLM Financial Advice with Repeated Risk-Tolerance Responses
The study examines how large language models (LLMs) provide financial advice based on a single risk‑tolerance question, finding that both human respondents and LLMs exhibit significant variability when the same question is repeated. In a national US panel, 41% of households changed their risk answer after two years, and in a lab retest a third changed by two or more points on a 0‑10 scale after six months. When LLMs were given 800 real household profiles with only the risk answer altered, the recommended stock allocation shifted by 10–16 percentage points on average, and by 24–35 points when the answer changed, compared to minimal swings when the same prompt was repeated. The study also shows that adding clarifying questions or noting answer noise can reduce these swings, especially for younger clients and those with extreme risk attitudes. whyItMatters":"The findings highlight that LLMs can produce markedly different financial advice from a single, potentially unreliable risk‑tolerance response, underscoring the need for repeat‑testing and transparency in AI‑driven financial recommendations."
arXiv AI
Sep 7
Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?
The paper proposes a new method for evaluating AI accountability by analyzing the structural quality of a model’s defense for its decisions, using a four‑phase dialectical protocol based on Walton’s argumentation schemes and Govier’s criteria. Applied to nine large language models and 200 ambiguous moral-choice items, the study finds that models generally defend their reasoning well above the rubric minimum, though failures cluster on grounds and sufficiency and correlate with epistemic hedging. The protocol also reveals that models often present different argument schemes in justification than in reasoning, detects indefensible defenses, and highlights challenges in assessing retraction in AI alignment.
arXiv Computation and Language
Oct 1
Multi-agent discussion gains less when dissent is withheld
arXiv:2609.38324v1 Announce Type: cross Abstract: Multi-agent systems of LLMs add discussion to majority voting and are therefore expected to be more capable. However, empirical reports conflict on w...