arXiv Machine Learning

Directly Optimizing Mean Demographic Parity for Nonlinear Regression

The paper introduces DPVar, a fairness metric that measures the variance of the conditional mean prediction to directly optimize mean demographic parity in nonlinear regression. It presents two solvers—FBO, using a closed‑form hypergradient, and ITD, which differentiates through the conditional‑mean estimator updates—to handle the resulting functional bilevel problem. Experiments on 21 tabular datasets and the Communities & Crime data show that these methods achieve competitive or superior accuracy‑fairness trade‑offs compared to existing approaches.

arXiv Machine Learning
Jul 7

Functional Bilevel Optimization for Predictive Fairness

arXiv:2607. 05098v1 Announce Type: new Abstract: When sensitive attributes are continuous and high-dimensional $-$ demographic score vectors, posteriors over attributes, age or income profiles $-$ enforcing full statistical independence is often too restrictive, and existing relaxations rely on indirect dependence penalties or adversarial schemes that do not directly target the fairness-accuracy trade-off.

By Ieva Petrulionyte, Julien Mairal, Michael Arbel
arXiv Machine Learning
5d ago

Geometry of Relaxed Fair Regression: A Unified Framework for Aware and Unaware Settings

The paper introduces a unified framework for relaxed fair regression that applies to both aware and unaware settings. By modeling regression with a demographic parity penalty as an optimal transport problem, it characterizes optimal prediction functions under squared Wasserstein‑2 and Total Variation penalties, revealing distinct fairness philosophies. The authors also present FAUST, an efficient algorithm that consistently matches or surpasses state‑of‑the‑art baselines on real‑world benchmarks.

By Marie Generali Lince, Vincent Divol, R\'emi Flamary, Solenne Gaucher, Patrick Loiseau
arXiv Computation and Language
Oct 26

Principled Nonlinear Concept Erasure and Steering

arXiv:2610.32516v1 Announce Type: cross Abstract: Learned representations often encode sensitive attributes, such as gender or race, that may be undesirable or unsafe to retain. Concept erasure aims...

By Idan Simai, Shauli Ravfogel, Uri Shaham
Hugging Face Trending Papers
Oct 28

FairSplit: Decomposing the Embedding Space for Fair Classification

FairSplit decomposes the embedding space into a Fair Space for prediction and a Sensitive Space that isolates sensitive information, using a learnable mask and the Hilbert‑Schmidt Independence Criterion (HSIC) to guide the separation. The method simultaneously trains for classification accuracy and independence from sensitive attributes, providing theoretical bounds on the demographic parity gap based on the Fair Space dimensionality and HSIC. It supports multiclass tasks and non‑binary sensitive attributes, achieving competitive accuracy‑fairness trade‑offs on established benchmarks.

arXiv Statistics ML
Oct 28

Targeted Learning for Inference on Data Fairness

The paper introduces a targeted learning approach to assess fairness in the data generating process used for training predictive models, rather than focusing solely on model performance. It derives estimators for demographic parity, equal opportunity, and conditional mutual information, and demonstrates through simulations that these estimators improve confidence‑interval coverage and reduce false detections of population unfairness compared to fixed‑model inference. The authors also apply the method to real data to illustrate its practical utility.

By Joseph H. Rudoler, Alexander Asemota, Giles Hooker
arXiv AI
Jul 13

Tuning Derivatives for Causal Fairness in Machine Learning

arXiv:2605. 05882v2 Announce Type: replace-cross Abstract: Artificial-intelligence systems are becoming ubiquitous in society, yet their predictions typically inherit biases with respect to protected attributes such as race, gender, or age.

By Filip Edstr\"om, Guilherme W. F. Barros, Tetiana Gorbach, Xavier de Luna
arXiv Machine Learning
Aug 27

Controlling for Omitted Variable Bias in Deep Neural Networks

The paper introduces a control‑variable framework for deep neural networks to mitigate omitted variable bias, particularly shortcut learning where covariates like demographics influence predictions. It refits the final layer of a pre‑trained network using cross‑fitting with ridge penalisation, orthogonalises covariate effects, and marginalises predictions over covariate distributions to achieve unbiased, interpretable results. Experiments on simulated images and neuroimaging data show consistent estimation of true effects and performance close to models trained on unconfounded data.

By Manuel Pfeuffer, Roshan Prakash Rane, Kerstin Ritter, Sonja Greven
arXiv Machine Learning
Sep 1

Prediction-Powered Conditional Inference

arXiv:2603.05575v2 Announce Type: replace-cross Abstract: We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a blac...

By Yang Sui, Jin Zhou, Hua Zhou, Xiaowu Dai