arXiv Machine Learning

FairLRF: Achieving Fairness through Sparse Low Rank Factorization

FairLRF proposes a fairness-oriented low rank factorization framework that uses singular value decomposition (SVD) to improve deep learning model fairness. By selectively removing bias-inducing elements from the unitary matrices obtained via SVD, the method reduces group disparities while preserving accuracy. Experiments demonstrate that FairLRF outperforms existing low rank factorization and state-of-the-art fairness techniques, and an ablation study explores the impact of key hyper-parameters.

arXiv AI
Aug 17

Training Fair Tabular Foundation Models

arXiv:2608. 14211v1 Announce Type: cross Abstract: Tabular Foundation Models (TFMs) have emerged as leading methods for tabular predictive tasks, leveraging in-context learning to predict on new data without task-specific training.

By Patrik Kenfack, Jesse C. Cresswell, Anthony L. Caterini, Samira Ebrahimi Kahou, Ulrich A\"ivodji
arXiv AI
Aug 19

FairNVT: Fair Classification via Noise Injection in Vision Transformers

FairNVT is a lightweight debiasing framework that injects calibrated Gaussian noise into sensitive embeddings learned by adapters for pretrained transformer-based encoders. By reducing sensitive-attribute leakage through orthogonality constraints and fairness regularization, it improves fairness metrics such as demographic parity difference and equalized odds while maintaining competitive task performance across vision and language datasets.

By Qiaoyue Tang, Sepidehsadat Hosseini, Mengyao Zhai, Thibaut Durand, Greg Mori
arXiv Machine Learning
Aug 10

Let's Unlearn Stereotypes Before Decision-Making: Assessing the Impact of Intrinsic Bias Mitigation on Downstream Fairness in LLMs

arXiv:2509. 16462v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly used in high-stakes decision-making systems, where biased predictions can reinforce social and economic disparities.

By Mina Arzaghi, Alireza Dehghanpour Farashah, Florian Carichon, Jean-Fran\c{c}ois Plante, Golnoosh Farnadi