arXiv Machine Learning

Debias Anything: Fairness with Diversity without Supervision in Diffusion Models

The paper introduces a method called Debias Anything that jointly addresses fairness and diversity in diffusion models without requiring sensitive-attribute annotations. By connecting a frozen diffusion model to a pretrained vision-language embedding space via an adapter, the approach uses pairs of text prompts to guide batch composition toward desired attribute proportions and employs a disagreement score to promote diversity. The method is applicable to both unconditional and text-conditional diffusion models and demonstrates improved quality and diversity while maintaining comparable fairness levels in experiments.

arXiv Machine Learning
Jun 2

KG-FairDiff: Knowledge Graph-Guided Prompt Refinement for Demographically Fair Text-to-Image Generation

arXiv:2606. 01282v1 Announce Type: cross Abstract: Text-to-Image (TTI) systems are now everyday infrastructure for journalism, education, advertising, and public communication, and the demographic and cultural stereotypes they inherit from training data (rendering women, people of colour, older adults, and non-Western cultures as under-represented or caricatured) become a population-level harm at deployment scale.

By Farbod Davoodi, Seyed Reza Tavakoli Shiyadeh, Pooria Safaei, Sana Harighi, Parsa Gholami, Amirali Amini, Kimia Vanaei, Emad Firoozi, Parham Abed Azad, Babak Khalaj, Siavash Ahmadi, Amir Hossein Payberah, Mohammad Hossein Rohban, Soheil Kolouri, Ali Diba
arXiv AI
Jul 17

Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation

arXiv:2607. 14962v1 Announce Type: cross Abstract: Text-to-image (T2I) models can synthesize realistic, prompt-aligned images, yet samples generated for the same prompt often cover only a small subset of visually distinct modes.

By Ku Onoda, Paavo Parmas, Hiroki Furuta, Soichiro Nishimori, Yuta Oshima, Shohei Taniguchi, Yutaka Matsuo
arXiv AI
Aug 19

FairNVT: Fair Classification via Noise Injection in Vision Transformers

FairNVT is a lightweight debiasing framework that injects calibrated Gaussian noise into sensitive embeddings learned by adapters for pretrained transformer-based encoders. By reducing sensitive-attribute leakage through orthogonality constraints and fairness regularization, it improves fairness metrics such as demographic parity difference and equalized odds while maintaining competitive task performance across vision and language datasets.

By Qiaoyue Tang, Sepidehsadat Hosseini, Mengyao Zhai, Thibaut Durand, Greg Mori
arXiv Computer Vision
Aug 27

Learning Late, Guiding Early: Timestep-Decoupled Semantic Guidance for Fair Face Generation

The paper introduces Semantic Boundary Predictor (SBP), an inference‑time framework that improves demographic fairness in synthetic face generation by applying a single, one‑shot intervention during reverse denoising. SBP learns linear semantic boundaries from late‑stage latent representations and applies them only at the initial noisy latent, leaving the rest of the diffusion process unchanged. Experiments on CelebA‑HQ show significant reductions in fairness disparity—98% for gender, 95% for binary race, and 15% for four‑class race—while preserving image quality across demographic groups.

By Subir Kumar Parida, Rajbabu Velmurugan, Ketan Kotwal, R. S. Sengar, Swati Hiremath