arXiv Machine Learning
Audit Me If You Can: Query-Efficient Active Fairness Auditing of Black-Box LLMs
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 30
Sequential Fairness Auditing with Limited Output Access
arXiv:2606. 30338v1 Announce Type: new Abstract: External evaluations are becoming increasingly central to the governance of AI systems.
arXiv Machine Learning
Jul 1
White-Box Sensitivity Auditing with Steering Vectors
arXiv:2601. 16398v3 Announce Type: replace-cross Abstract: Algorithmic audits are essential tools for examining systems for properties required by regulators or desired by operators.
arXiv Machine Learning
Jul 31
What Must a Fairness Audit Report When Demographic Data Is Incomplete?
arXiv:2506. 23033v5 Announce Type: replace Abstract: Fairness audits are a key component of responsible machine-learning deployment.
arXiv Machine Learning
1d ago
Accuracy Is Not Enough: A Cross-Architecture Audit of Demographic Bias in Deep Knowledge Tracing
The study audits demographic bias across four deep knowledge tracing architectures—DKT, DKVMN, SAKT, and AKT—using two large public datasets (Eedi and OULAD). It finds that bias is context‑dependent: socioeconomic bias is significant on Eedi, while gender bias appears on OULAD for most models. The most accurate model, AKT, also exhibits the greatest bias, and standard mitigation techniques such as reweighting and adversarial debiasing fail to reduce bias without sacrificing accuracy.
arXiv AI
3d ago
FairLint-DL: An IDE-Native Tool for Fairness Debugging of Deep Learning Software
arXiv:2609.16321v1 Announce Type: cross Abstract: Existing fairness analysis tools predominantly operate as post-training evaluation frameworks, requiring practitioners to complete the full model dev...
arXiv Machine Learning
Aug 4
Fairness Auditing: Lower Bounds on Company Manipulation
arXiv:2608. 00568v1 Announce Type: new Abstract: Fairness audits are increasingly mandated in high-stakes applications such as hiring, lending, and automated decision-making.