arXiv Computer Vision

Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generation

The paper introduces Semantic Boundary Predictor (SBP), an inference‑time framework that improves demographic fairness in synthetic face generation by applying a single, one‑shot intervention during reverse denoising. SBP learns linear semantic boundaries from late‑stage latent representations and applies them only at the initial noisy latent, leaving the rest of the diffusion process unchanged. Experiments on CelebA‑HQ show significant reductions in fairness disparity—98% for gender, 95% for binary race, and 15% for four‑class race—while preserving image quality across demographic groups.

arXiv Computer Vision
Sep 1

FairReL: Deepfake Detection using Fairness-Aware Representation Learning

FairReL is a fairness‑aware representation‑learning framework for deepfake detection that targets two subgroup‑sensitive components: multi‑scale spatial features and fine‑tuning‑induced residual features. It uses an SVD‑decomposed backbone to isolate residuals and introduces Group‑Conditional Wavelet Decorrelation (GCWD) and Subspace‑Localised Mean Alignment (SLMA) losses to suppress subgroup imbalance and align subgroup means. Experiments on FF++, Celeb‑DF, DFD, and DFDC show that FairReL improves unseen‑dataset AUC by 3.9% and reduces subgroup FPR disparity by 10.2% compared to the state‑of‑the‑art fairness‑aware detector.

By Xiaoman Lu, Jiaqi Li, Shuntian Zheng, Huiping Chen, Yu Guan
arXiv AI
4d ago

ScoreMix: Synthetic Data Generation by Score Composition in Diffusion Models Improves Recognition

ScoreMix is a self‑contained synthetic data generation method that improves recognition tasks by mixing class‑conditioned scores along reverse diffusion trajectories, thereby creating hard synthetic samples without external resources. The approach shows that selecting classes far apart in the discriminator’s embedding space yields larger performance gains, up to 3% more improvement than proximity‑based selection. Across eight public face recognition benchmarks, ScoreMix boosts accuracy by up to 7 percentage points, demonstrating robustness and practicality without hyperparameter tuning.

By Parsa Rahimi, Sebastien Marcel
arXiv Machine Learning
Aug 27

Fairness-Aware Test-Time Prompt Tuning

The paper introduces FairTPT, a fairness-aware test‑time prompt tuning method for vision‑language models like CLIP. It jointly minimizes target marginal entropy while maximizing spurious marginal entropy to reduce bias under subpopulation shifts. Experiments show that standard episodic test‑time adaptation can worsen disparities, but FairTPT outperforms existing debiasing methods while preserving overall performance.

By Yoann Launay, Parameswaran Kamalaruban, Tom Kempton, Stuart Burrell, David Sutton