PopResume is a population‑representative resume dataset designed for causal fairness auditing of large language model (LLM) and vision‑language model (VLM) resume screeners. It grounds fairness evaluation in real population statistics and preserves natural attribute relationships, enabling path‑specific effect (PSE) analysis that separates business‑necessity from redlining pathways. Using PopResume, the authors evaluated eight models on 60.8K resumes across five occupations and uncovered five discrimination patterns that aggregate metrics missed, demonstrating the value of causally‑grounded auditing.
By Sumin Yu, Juhyeon Park, Taesup Moon
The paper proposes a scalable, automated method for auditing candidate‑job matching systems for demographic bias. It employs large‑language‑model agents to generate neutral resumes, injects controlled demographic variations, ranks candidates with a fine‑tuned embedding model, and evaluates nine fairness metrics across counterfactual, group‑fairness, and merit‑aware families, producing a composite risk report. Experiments on a small corpus show that single‑score audits miss nuanced issues, underscoring the need for multi‑metric evaluation and LLM‑generated audits as a low‑cost complement to human reviews.
By Sai Yashwant, Shruti Bansal, Anurag Dubey, Samaroha Chatterjee, Satyam Kumar, Shreyash Gupta, Gantala Thulsiram
The study evaluates how to reduce fabricated claims in multi‑stage large language model (LLM) hiring pipelines. Prompt guardrails alone cut fabrication density by 86 % but still left half of outputs containing false claims, while adding a human‑in‑the‑loop checkpoint after resume improvement eliminated all identity fabrications and significantly lowered overall fabrication rates. The results show that a layered approach—combining prompt guardrails with human checkpoints—provides stronger protection against severe failures without harming the quality of the final outputs.
By Hiroko Takano
arXiv:2608. 06949v1 Announce Type: new Abstract: Prior benchmarking work has shown that a single large language model (LLM), forced to make life-or-death resource-allocation decisions, exhibits measurable demographic bias.
By Paul-Peter Arslan
The paper introduces candidate‑fate accounting, an audit framework for transparent sensor diagnostic pipeline search that records every candidate, including invalid, pruned, or skipped ones, and assigns a terminal fate to each. It enhances traceability by hashing repeated observations, flagging illegal candidates, and documenting budget rationales. Experiments on three bearing‑diagnostic datasets demonstrate that the framework uncovers 30–41 omitted candidates and verifies complete accounting while preserving competitive performance.
By Haotao Xie, Yutian Chen, Yangqi Liu, Xiaoyu Jiang
The study examines a two‑agent résumé screening process where both employer‑side and candidate‑side agents exchange evidence before deciding who advances, contrasting it with the traditional one‑call automated screening. Using GPT‑5.5 and Claude Opus 4.7 on 600 constructed résumé‑job pairs, the two‑agent method increased the proportion of applications advanced (up to 39.3% for GPT‑5.5) and raised pass rates for borderline cases from 4.5% to 26.2% (GPT‑5.5) and 6.5% to 16.1% (Opus 4.7). The results show that the screening procedure itself, rather than just the underlying model, determines which candidates reach human review and how consistently that access recurs.
By Jian Gao, Hang Jiang