arXiv Machine Learning

Counterfactual Marginalisation: Framework for Evaluating Robustness to Nuisance Variables

The paper introduces counterfactual (CF) marginalisation, a test‑time evaluation method that assesses how robust classification models are to nuisance variables such as age or sex. By using a CF image generator to intervene on these parent variables, the method creates counterfactual versions of each test image and averages predictions over a chosen intervention distribution, yielding intervention‑aware predictions that filter out demographic effects while retaining patient‑specific latent information. These predictions are then used to define metrics for CF risk, calibration, stability, and worst‑case sensitivity, demonstrating the framework’s usefulness for quantitative robustness evaluation.

arXiv Machine Learning
Jun 8

Automatic, Debiased, and Invariant Counterfactual Generation under General Interventions

arXiv:2606. 07399v1 Announce Type: cross Abstract: Generative models for counterfactual outcomes have great potential to support decision-making under complex interventions, but existing approaches are limited by unstable estimation, poor generalization across environments, and bias from nuisance model misspecification.

By Raphael C Kim, Jingsen Zhu, Ramin Zabih, Michele Santacatterina
arXiv AI
Jul 17

Demographically-Conditioned Synthetic Medical Images for Bias Mitigation and Bias Detection in Disease Classifiers

arXiv:2607. 14984v1 Announce Type: new Abstract: Per-subgroup fairness audits of medical image classifiers face a sample-size problem: minority subgroups in held-out test sets have so few samples that the resulting confidence intervals on per-subgroup performance are wider than the bias the audit is meant to detect.

By Mahmoud Ibrahim, Bart Elen, Chang Sun, Gokhan Ertaylan, Michel Dumontier
arXiv AI
Aug 20

Counterfactual Contrastive Analysis

The paper introduces a classifier‑free method for generating visual counterfactual explanations (VCEs) using Contrastive Analysis (CA). By separating generative factors common to two datasets from those specific to each class, the approach swaps only the salient factors to produce counterfactual images, thereby avoiding reliance on classifier decision boundaries. Leveraging StyleGAN2’s high‑quality synthesis and a feature‑space latent representation, the method supports multiple salient factors per dataset and achieves superior counterfactual quality on three medical imaging datasets.

By Yunlong He, Pietro Gori
arXiv Machine Learning
Jul 9

Counterfactual Modeling with Fine-Tuned LLMs for Health Intervention Design and Sensor Data Augmentation

arXiv:2601. 14590v3 Announce Type: replace Abstract: Counterfactual explanations (CFEs) provide human-centric interpretability by identifying the minimal, actionable changes required to alter a machine learning model's prediction.

By Shovito Barua Soumma, Asiful Arefeen, Stephanie M. Carpenter, Melanie Hingle, Hassan Ghasemzadeh
arXiv AI
Jun 4

Counterfactual Explanations for Deep Two-Sample Testing

arXiv:2606. 04009v1 Announce Type: cross Abstract: Two-sample testing is a fundamental tool for detecting distributional differences across scientific domains, but classical tests (including kernel-based tests) can be ineffective on high-dimensional structured data such as images.

By Wei-Cheng Lai, Marco Simnacher, Christoph Lippert