arXiv Machine Learning

When Reconstruction Is Not Enough: Doubly Robust Counterfactual and Interventional Mediation Analysis with Learned Multimodal Representations

The paper investigates how learned multimodal representations of high‑dimensional health data can fail to preserve causal information, even when trained to reconstruct the data. It establishes conditions under which a representation is sufficient for causal identification, shows that interventional mediation requires stricter preservation than counterfactual comparison, and proves that reconstruction‑based objectives cannot certify sufficiency. The authors decompose the error of cross‑fitted doubly robust estimators into a first‑order representation bias and a second‑order nuisance‑estimation remainder, demonstrating that coverage can deteriorate with larger samples if the representation is insufficient. They propose a practical workflow that combines modality‑specific variational autoencoders, cross‑fitted doubly robust estimation, locked phenotypes, selective pathway analysis, portable representations, and diagnostics for representation insufficiency, exposure leakage, and sensitivity, and validate it in simulations where a rare confounder’s omission leads to severely under‑covered indirect‑effect intervals.

arXiv Machine Learning
Jul 9

Counterfactual Modeling with Fine-Tuned LLMs for Health Intervention Design and Sensor Data Augmentation

arXiv:2601. 14590v3 Announce Type: replace Abstract: Counterfactual explanations (CFEs) provide human-centric interpretability by identifying the minimal, actionable changes required to alter a machine learning model's prediction.

By Shovito Barua Soumma, Asiful Arefeen, Stephanie M. Carpenter, Melanie Hingle, Hassan Ghasemzadeh
arXiv Machine Learning
Oct 23

ACTIVA: Amortized Causal Effect Estimation via Variational Autoencoders

ACTIVA is a transformer‑based conditional variational autoencoder designed to estimate full interventional distributions from observational data without requiring interventional data, a causal graph, or per‑task fitting. It learns a conditional latent prior that amortizes causal knowledge across diverse training tasks, enabling a single forward pass to handle new causal models drawn from the training distribution. Empirical results on synthetic and biologically realistic gene‑expression simulations show that ACTIVA outperforms correlational baselines, reduces spurious non‑descendant effects, and matches strong amortized baselines, while also validating its theoretical mixture‑of‑distributions property on observationally equivalent models.

By Andreas Sauter, Saber Salehkaleybar, Frank van Harmelen, Aske Plaat, Erman Acar
arXiv Machine Learning
Oct 16

Flexible Doubly Robust Proximal Causal Inference for Censored Outcomes

The paper introduces Proximal Survival Bridge learning (PSB), a flexible doubly robust framework for estimating causal effects on right‑censored time‑to‑event outcomes under unmeasured confounding. PSB builds on proximal causal inference to produce outcome‑bridge, treatment‑bridge, and doubly robust estimators, and offers two flexible bridge learners: PSB‑K, a kernel estimator with low‑rank time decomposition, and PSB‑N, a neural estimator trained with a projected maximum‑moment‑restriction loss. Experiments on a standard SEM benchmark, a proximal semi‑synthetic ACTG study, and the real‑world Framingham study show PSB‑K excels on SEM and ACTG data, while PSB‑N provides greater stability on Framingham, with additional analyses demonstrating robustness to proxy quality and censoring levels.

By Dhanajit Brahma, Ruolin Meng, Lawrence Carin, Ricardo Henao
arXiv Statistics ML
Oct 5

Flexible Nonparametric Inference for Causal Effects under the Front-Door Model

The paper introduces new one‑step and targeted minimum loss‑based estimators for the average treatment effect and the average treatment effect on the treated under the front‑door criterion. These estimators use multiple parameterizations of the observed data distribution, can avoid modeling the mediator density, and are compatible with flexible machine‑learning nuisance estimation. The authors derive conditions for root‑n consistency, asymptotic linearity, and develop doubly robust tests for identification assumptions, demonstrating improved efficiency and favorable performance in simulations and real‑world applications in education and emergency medicine.

By Anna Guo, David Benkeser, Razieh Nabi