arXiv Computation and Language

Large Language Models Naively Recover Ethnicity from Individual Records

The paper shows that large language models can infer ethnicity from names with higher accuracy than Bayesian Improved Surname Geocoding (BISG), achieving up to 84.7% accuracy on balanced samples from Florida and North Carolina voter files. Six models, including Gemini 3 Flash, GPT‑4o, and open‑source alternatives, were tested, with extended reasoning and metadata such as party registration further improving performance. The method also reduces income bias present in BISG and is validated across diverse populations in India, Uganda, Nepal, Armenia, Chile, and Costa Rica, with fine‑tuned small transformer models surpassing BISG while allowing local deployment at no cost.

arXiv Computation and Language
4d ago

Pre-Trained Language Models as Zero-Shot Tools for Social Science Research

The paper demonstrates that pre‑trained language models can perform record linkage and demographic inference from names without task‑specific training. EnsembleLink, an algorithm that combines pre‑trained embeddings with string‑based scorers, achieves performance comparable to or better than prior methods across diverse scripts and formats. Large language models reach up to 83.8% accuracy on U.S. voter files for ethnicity inference, surpassing name‑supplemented BISG and enabling inference for non‑U.S. ethnic categories while reducing bias in geographic racial gap estimates.

By Noah Dasanaike
arXiv Machine Learning
Jul 21

STRATA: A Name-and-Geography Race Inference Model for Fair Lending and Housing Equity Applications

arXiv:2504. 21259v2 Announce Type: replace-cross Abstract: Accurate imputation of race and ethnicity (R&E) is essential for fair lending compliance under ECOA, HMDA, and the Community Reinvestment Act, where up to 15% of mortgage applications carry missing race data and regulated institutions bear responsibility for identifying disparities on those records.

By S. Chalavadi, A. Pastor, T. Leitch
arXiv Machine Learning
Sep 3

Probing Cultural Signals in Large Language Models through Author Profiling

The study investigates cultural biases in large language models (LLMs) by testing their ability to perform author profiling—inferring singers’ gender and ethnicity—from song lyrics in a zero‑shot setting. Evaluating over 10,000 lyrics across several open‑source models, the authors find that most LLMs default toward North American ethnicity, while DeepSeek‑1.5B leans toward Asian ethnicity, and that Ministral‑8B exhibits the strongest ethnicity bias whereas Gemma‑12B is the most balanced. The paper introduces two fairness metrics, Modality Accuracy Divergence (MAD) and Recall Divergence (RD), to quantify these disparities and provides code and results publicly on GitHub and HuggingFace.

By Valentin Lafargue, Ariel Guerra-Adames, Emmanuelle Claeys, Elouan Vuichard, Jean-Michel Loubes
arXiv Machine Learning
Jul 24

How Robust Is Homogeneity Bias in LLMs? Evidence Across Models, Decoding Settings, and Identity Signals

arXiv:2501. 02211v3 Announce Type: replace-cross Abstract: Large language models (LLMs) reproduce homogeneity bias -- the tendency to portray marginalized groups as more internally similar than dominant groups -- but whether this bias generalizes across models, is stable under different inference settings, or depends on how group identity is signaled remains unstudied.

By Messi H. J. Lee
arXiv Computation and Language
3d ago

Name-Bias in Large Language Models

The study evaluates name-based bias in six local large language models using a fill-in-the-blank task with first names from U.S. Social Security and a race classification dataset. Across 300,000 responses, the models consistently favored names that were less stereotypically male, older, popular, and white, with gender bias being the strongest effect. The bias varied with sentence context but remained significant, underscoring the persistence of name bias in local LLMs.

By Kalyan Bhetwal, Ceren Mert, Ian Whitehouse
arXiv AI
Sep 7

Cultural Misalignment in Large Language Models: Detection, Measurement, and Mitigation Through Targeted Fine-Tuning

The paper evaluates three open‑weight large language models—Gemma3‑12B (USA), Bielik‑11B‑v3 (Poland), and Qwen3‑4B (China)—against World Values Survey data for 63 demographic personas across three countries, using normalized Wasserstein distance to measure cultural misalignment. Surprisingly, none of the models shows a preference for its home country; Qwen3‑4B, built in China, has the highest misalignment for Chinese respondents. Targeted LoRA fine‑tuning on the five worst‑case personas, with fewer than 1,200 training pairs and under 15 minutes on a single GPU, reduces bias by 16.8% for Bielik‑11B, but the fine‑tuning redistributes bias rather than eliminating it, shifting worst‑case personas from American to Chinese elderly.

By Antoni Czolgowski, Abel Iyasele
arXiv Computation and Language
Oct 12

Knowing Is Not Telling: Identity Ossification in LLM Representations of Trans-border Communities

The paper investigates how large language models (LLMs) represent nine transborder ethnic communities along China’s southwestern border with mainland Southeast Asia, such as the Sami, Rohingya, and Kurds. It introduces the concept of identity ossification, where LLMs reduce fluid, cross-border identities to a single nation-state narrative, and presents the Transborder Identity Ossification Diagnostic Framework (TIODF) to differentiate between knowledge gaps and narrative framing. Experiments with GPT‑5.1 and DeepSeek‑V3.2 in English and Chinese show that ossification rates vary widely, with DeepSeek‑V3.2’s Chinese responses exhibiting the phenomenon in 62.6% of cases, indicating that narrative framing rather than mere knowledge absence drives the issue.

By Minglu Sun, Lan Chen, Hang Jiang
arXiv AI
Oct 2

Multicalibration for Unbiased Model-Based Prevalence Estimation

The paper presents multicalibration as a method for unbiased prevalence estimation when measurement devices (diagnostic tests, classifiers, or large language models) exhibit covariate shift. It shows that standard calibration fails under such shift, while multicalibration—calibrating conditional on input features—maintains near-zero bias in simulations and real-world applications. The authors demonstrate the approach on employment data across U.S. states and political text classification across four countries, emphasizing the need for calibration data that covers key feature dimensions.

By Fridolin Linder, Thomas Leeper, Daniel Haimovich, Niek Tax, Lorenzo Perini, Milan Vojnovic