Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper argues that fairness failures in generative models arise mainly from inadequate evaluation practices, making fairness findings hard to compare or use for deployment. It diagnoses common empirical and conceptual shortcomings in current methods and calls for a move toward standardized, generative‑specific evaluation. The authors introduce Fairness Cards, a minimal reporting artifact that explicitly documents evaluation choices—such as prompt families, counterfactual protocols, metrics, and refusal handling—to improve reproducibility, comparability, and accountability.
Despite groundbreaking advancements in generative models during the last decade, concerns about their lack of fairness, reinforcing societal inequalities and harming marginalized groups, remain under-...
The paper investigates the tradeoff between fairness and accuracy when a single predictive model serves multiple demographic groups. It introduces the fairness-accuracy (FA) Pareto frontier, which identifies models that cannot be improved in either dimension without compromising the other. Focusing on finite-sample settings, the authors derive worst‑case‑optimal estimators, analyze how limited data asymmetrically affect each group’s welfare, and provide uniform bounds along the entire FA frontier.
arXiv:2607. 28934v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly involved in the distribution of scarce resources, raising concerns about biased allocations based on characteristics like race and gender.
arXiv:2606. 01719v1 Announce Type: cross Abstract: Machine learning models trained on sensitive data can inadvertently leak population-level information about their training distributions -- a threat known as distribution inference attack (DIA).
The paper introduces a targeted learning approach to assess fairness in the data generating process used for training predictive models, rather than focusing solely on model performance. It derives estimators for demographic parity, equal opportunity, and conditional mutual information, and demonstrates through simulations that these estimators improve confidence‑interval coverage and reduce false detections of population unfairness compared to fixed‑model inference. The authors also apply the method to real data to illustrate its practical utility.