arXiv AI By Abdullah X

Status Association Does Not Reliably Predict Decision Leakage

Read the original on arXiv AI →

arXiv:2608. 10089v1 Announce Type: cross Abstract: Bias evaluations often move too quickly from evidence that a model encodes a social association to claims that the same association will alter consequential decisions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 20

Institutional Prestige as Geographic Bias in Large Language Models: Evidence from Three Factorial Experiments with Bootstrap Confidence Intervals

The study examines whether large language models (LLMs) discriminate against candidates based on institutional prestige and geographic location. Three factorial experiments (4,320 API calls across four LLMs and five domains) reveal a significant institution‑tier gradient (+0.297 points on a 10‑point scale), a stronger prestige effect than country‑of‑origin effect, and a dominant journal prestige effect (Nature vs. a peripheral journal). The authors also identify a ‘rescue effect’ where publishing in Nature mitigates low institutional prestige, and quantify bias using the Neutrosophic Bias Index, highlighting evaluation inconsistency for low‑prestige profiles.

By Maikel Leyva-Vazquez, Florentin Smarandache
arXiv Machine Learning
Jul 24

How Robust Is Homogeneity Bias in LLMs? Evidence Across Models, Decoding Settings, and Identity Signals

arXiv:2501. 02211v3 Announce Type: replace-cross Abstract: Large language models (LLMs) reproduce homogeneity bias -- the tendency to portray marginalized groups as more internally similar than dominant groups -- but whether this bias generalizes across models, is stable under different inference settings, or depends on how group identity is signaled remains unstudied.

By Messi H. J. Lee
arXiv AI
Sep 10

The Audit Decides the Verdict: Instrument Effects Rival Demographic Bias in LLM Decision Audits

The study examines how the design of audit questions influences perceived bias in large language models (LLMs). Using 40,726 requests across five models and three domains—hiring, lending, and medical triage—the authors find that demographic bias effects are not replicated when the audit is standardized. Instead, the audit’s construction, such as question phrasing and ordering, has a stronger impact on model responses than applicant demographics.

By Siddharth Vohra, Manikandan Ravikiran