arXiv AI By Mahika Phutane, Hayoung Jung, Matthew Kim, Tanushree Mitra, Aditya Vashistha

ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios

Read the original on arXiv AI →

The paper "ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios" audits six large language models across 2,820 hiring scenarios that vary by disability, gender, nationality, and caste. It introduces the ABLEIST framework—comprising five ableism-specific and three intersectional harm metrics—to detect subtle biases. The study finds that many state‑of‑the‑art models exhibit significant ABLEIST harms, especially for gender- and caste-marginalized disabled candidates, exposing blind spots in current safety tools.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
3d ago

LLMs Cannot Be Neutral: Gender Sensitivity Across Candidates, Evaluators, and Models

The study investigates how gender assignments of candidates and evaluators influence decisions made by large language models (LLMs) in a city council voting scenario. Eight LLM-as-a-Judge and decision language models evaluated 240 synthetic professional narratives, producing 30,720 judgments. Results show that explicit candidate gender labels slightly increased the probability of a Yes vote, only nonbinary evaluator assignments had a significant effect, and decision reversals varied across models, with decision language models exhibiting fewer reversals than LLM-as-a-Judge models.

By Danial Amin, Joni Salminen, Bernard J. Jansen
arXiv Machine Learning
Sep 3

FairLens: Benchmarking Fairness in Vision-Language Models for High-Stakes Decision-Making

FairLens is a benchmark and evaluation framework that measures fairness and validity of vision‑language models (VLMs) in high‑stakes domains such as hiring, legal, and healthcare. It uses over 100,000 face‑image and question pairs covering gender, race, and age, and assesses responses through demographic parity, soundness, demographic association, and bias in free‑text generation. The study finds that VLMs often make unwarranted inferences from faces rather than abstaining, especially in legal and healthcare contexts, and that small parity gaps can still hide unsafe treatment across groups.

By Vahid Reza Khazaie, Ahmed Y. Radwan, Shaina Raza