Hugging Face Trending Papers
Name-Bias in Large Language Models
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv Computation and Language
Oct 16
Name-Bias in Large Language Models
The study evaluates name-based bias in six local large language models using a fill-in-the-blank task with first names from U.S. Social Security and a race classification dataset. Across 300,000 responses, the models consistently favored names that were less stereotypically male, older, popular, and white, with gender bias being the strongest effect. The bias varied with sentence context but remained significant, underscoring the persistence of name bias in local LLMs.
arXiv Computation and Language
Sep 1
Different Demographic Cues Yield Inconsistent Conclusions About LLM Personalization and Bias
The paper examines how large language models (LLMs) respond to different demographic cues—such as names—when users seek advice, focusing on race and gender in a U.S. context. It finds that using different cues for the same group leads to only partially overlapping changes in model responses, producing inconsistent conclusions about personalization and unstable bias metrics. The authors argue that LLMs react to linguistic signals tied to cues rather than to stable demographic categories, and they call for evaluations that use multiple cues and consider underlying mechanisms.
arXiv Machine Learning
Jul 24
How Robust Is Homogeneity Bias in LLMs? Evidence Across Models, Decoding Settings, and Identity Signals
arXiv:2501. 02211v3 Announce Type: replace-cross Abstract: Large language models (LLMs) reproduce homogeneity bias -- the tendency to portray marginalized groups as more internally similar than dominant groups -- but whether this bias generalizes across models, is stable under different inference settings, or depends on how group identity is signaled remains unstudied.
arXiv AI
Jul 24
ImplicitBBQ: Benchmarking Implicit Bias in Large Language Models through Characteristic Based Cues
arXiv:2604. 01925v2 Announce Type: replace-cross Abstract: Large Language Models increasingly suppress biased outputs when demographic identity is stated explicitly, yet may still exhibit implicit biases when identity is conveyed indirectly.
arXiv Machine Learning
Jun 25
Homogeneity Bias in Open-Weight LLMs Is Robust to Decoding Hyperparameters
arXiv:2501. 02211v2 Announce Type: replace-cross Abstract: Large language models (LLMs) reproduce homogeneity bias -- the tendency to portray marginalized groups as more internally similar than dominant groups -- but whether this bias is stable or an artifact of inference settings has only been studied in single proprietary models.
arXiv AI
Aug 13
Large Language Models Reproduce Racial Stereotypes When Used for Text Annotation
arXiv:2603. 13891v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly used for automated text annotation in tasks ranging from academic research to content moderation and hiring.