arXiv Computer Vision

Efficient Fairness Auditing Across Guidance Scales in Text-to-Image Diffusion Models via Causal Abstraction

arXiv Machine Learning
Oct 3

Debias Anything: Fairness with Diversity without Supervision in Diffusion Models

The paper introduces a method called Debias Anything that jointly addresses fairness and diversity in diffusion models without requiring sensitive-attribute annotations. By connecting a frozen diffusion model to a pretrained vision-language embedding space via an adapter, the approach uses pairs of text prompts to guide batch composition toward desired attribute proportions and employs a disagreement score to promote diversity. The method is applicable to both unconditional and text-conditional diffusion models and demonstrates improved quality and diversity while maintaining comparable fairness levels in experiments.

By Th\'eau d'Audiffret, Mariia Vladimirova, Jean-Yves Franceschi
Hugging Face Trending Papers
Jul 26

Learning Sampling Parameters for Diffusion Models

Text-to-image diffusion models expose many inference-time sampling parameters, including prompts, negative prompts, classifier-free guidance scales, and noise schedules. These parameters are typically manually chosen once and then held fixed across prompts and denoising timesteps, even though different prompts and stages of generation can benefit from different parameter values.

arXiv Machine Learning
Jun 2

KG-FairDiff: Knowledge Graph-Guided Prompt Refinement for Demographically Fair Text-to-Image Generation

arXiv:2606. 01282v1 Announce Type: cross Abstract: Text-to-Image (TTI) systems are now everyday infrastructure for journalism, education, advertising, and public communication, and the demographic and cultural stereotypes they inherit from training data (rendering women, people of colour, older adults, and non-Western cultures as under-represented or caricatured) become a population-level harm at deployment scale.

By Farbod Davoodi, Seyed Reza Tavakoli Shiyadeh, Pooria Safaei, Sana Harighi, Parsa Gholami, Amirali Amini, Kimia Vanaei, Emad Firoozi, Parham Abed Azad, Babak Khalaj, Siavash Ahmadi, Amir Hossein Payberah, Mohammad Hossein Rohban, Soheil Kolouri, Ali Diba
arXiv Machine Learning
Oct 9

Enabling Preference-driven Unlearning in Few-step Distilled Text-to-Image Diffusion Models

The paper presents a preference-driven unlearning framework for few-step distilled text-to-image diffusion models. It identifies that standard Direct Preference Optimization (DPO) fails on these models due to altered generation dynamics and proposes a modified formulation aligned with few-step properties. The method enables direct concept removal while preserving desirable capabilities, and is evaluated on identity, NSFW, and object-level unlearning tasks with strong forgetting and retention results.

By Gaurav Patel, Jun Fang, Greg Ver Steeg, Qiang Qiu, Sravan Sripada
arXiv Machine Learning
Oct 9

Beyond Distributional Fidelity: Causal-Penalized Diffusion for Synthetic Tabular Data

The paper introduces a causal‑penalized diffusion model for generating synthetic tabular data, arguing that high statistical fidelity does not guarantee accurate causal inference. It defines causal fidelity as the discrepancy between inferential distributions from real and synthetic data and proposes a training framework that adds a causal discrepancy penalty to the generative objective. Experiments on treatment‑effect simulations and benchmark datasets demonstrate that the method can improve causal fidelity while maintaining competitive statistical fidelity.

By Lan Tao, Yongxian He, Shirong Xu, Yidong Ouyang, Guang Cheng