Text-to-image (T2I) models have been shown to exhibit social biases. Prior work has mainly focused on gender, skin tone, and cultural representation within restricted occupational associations, and emerging benchmarks increasingly incorporate these dimensions.
arXiv:2407.20371v3 Announce Type: replace-cross
Abstract: Artificial intelligence (AI) hiring tools have revolutionized resume screening, and large language models (LLMs) have the potential to do the...
By Kyra Wilson, Aylin Caliskan
The study investigates how gender assignments of candidates and evaluators influence decisions made by large language models (LLMs) in a city council voting scenario. Eight LLM-as-a-Judge and decision language models evaluated 240 synthetic professional narratives, producing 30,720 judgments. Results show that explicit candidate gender labels slightly increased the probability of a Yes vote, only nonbinary evaluator assignments had a significant effect, and decision reversals varied across models, with decision language models exhibiting fewer reversals than LLM-as-a-Judge models.
By Danial Amin, Joni Salminen, Bernard J. Jansen
arXiv:2604.20677v3 Announce Type: replace
Abstract: Large Language Models (LLMs) are increasingly deployed in socially sensitive settings, raising concerns about fairness and bias, particularly when...
By Chaima Boufaied, Ronnie De Souza Santos, Ann Barcomb
FairLens is a benchmark and evaluation framework that measures fairness and validity of vision‑language models (VLMs) in high‑stakes domains such as hiring, legal, and healthcare. It uses over 100,000 face‑image and question pairs covering gender, race, and age, and assesses responses through demographic parity, soundness, demographic association, and bias in free‑text generation. The study finds that VLMs often make unwarranted inferences from faces rather than abstaining, especially in legal and healthcare contexts, and that small parity gaps can still hide unsafe treatment across groups.
By Vahid Reza Khazaie, Ahmed Y. Radwan, Shaina Raza
arXiv:2607. 28934v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly involved in the distribution of scarce resources, raising concerns about biased allocations based on characteristics like race and gender.
By Martin Lukk (University of Toronto)