arXiv AI

Fairness-Aware Mixture-of-Experts via Subgroup Reweighting and Gate Regularization

The paper proposes a fairness-aware Mixture-of-Experts (MoE) framework that tackles routing-induced bias by applying subgroup reweighting to correct data imbalance and gate entropy regularization to prevent the gating network from collapsing onto subgroup attributes. This end-to-end approach keeps expert utilization balanced and interpretable, offering a clear view of how subgroups are allocated across experts. Experiments show that the method improves fairness while maintaining competitive predictive performance.

arXiv Machine Learning
Sep 21

Robust Mixture Models for Algorithmic Fairness Under Latent Heterogeneity

The paper introduces ROME, a framework that learns latent group structure while optimizing worst-group predictive performance. ROME links latent-variable modeling with distributionally robust optimization through an Expectation-Maximization approach for linear models and a neural Mixture-of-Experts for nonlinear settings. Experiments on simulations and three real-world regression datasets show that ROME improves worst-group performance while maintaining competitive overall accuracy compared to existing group-aware and group-label-free robust learning methods.

By Siqi Li, Molei Liu, Yiwei Lyu, Ziye Tian, Chuan Hong, Nan Liu
arXiv AI
Oct 16

Time to Fake It: Continual Machine Learning Intensifies Unfairness in Deepfake Detection

The paper examines how continual learning (CL) techniques used to update deepfake detectors over time affect fairness across different demographic groups. By training detectors on a chronological series of 11 real-world deepfake generation methods, the authors track four fairness dimensions and find that accuracy loss often worsens unfairness, while fairness gains are rare. The study reveals that inequitable forgetting is linked to representation learning rather than mere underrepresentation, urging CL methods to consider social outcomes when balancing stability and plasticity.

By Kajaree Das, Oliver B\"ose, Subarnaduti Paul, Gabriel Storch, Martin Mundt
arXiv Machine Learning
Aug 10

Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMs

arXiv:2509. 16462v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly used in high-stakes decision-making systems, where biased predictions can reinforce social and economic disparities.

By Mina Arzaghi, Alireza Dehghanpour Farashah, Florian Carichon, Jean-Fran\c{c}ois Plante, Golnoosh Farnadi
arXiv Computer Vision
Sep 1

FairReL: Deepfake Detection using Fairness-Aware Representation Learning

FairReL is a fairness‑aware representation‑learning framework for deepfake detection that targets two subgroup‑sensitive components: multi‑scale spatial features and fine‑tuning‑induced residual features. It uses an SVD‑decomposed backbone to isolate residuals and introduces Group‑Conditional Wavelet Decorrelation (GCWD) and Subspace‑Localised Mean Alignment (SLMA) losses to suppress subgroup imbalance and align subgroup means. Experiments on FF++, Celeb‑DF, DFD, and DFDC show that FairReL improves unseen‑dataset AUC by 3.9% and reduces subgroup FPR disparity by 10.2% compared to the state‑of‑the‑art fairness‑aware detector.

By Xiaoman Lu, Jiaqi Li, Shuntian Zheng, Huiping Chen, Yu Guan
arXiv AI
Aug 17

Training Fair Tabular Foundation Models

arXiv:2608. 14211v1 Announce Type: cross Abstract: Tabular Foundation Models (TFMs) have emerged as leading methods for tabular predictive tasks, leveraging in-context learning to predict on new data without task-specific training.

By Patrik Kenfack, Jesse C. Cresswell, Anthony L. Caterini, Samira Ebrahimi Kahou, Ulrich A\"ivodji