Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2603. 19186v3 Announce Type: replace Abstract: Randomized controlled trials (RCTs) are the gold standard for estimating treatment effects, yet they are often underpowered for detecting effect heterogeneity.
The paper proposes supervised learning objectives for estimating causal effects of high‑dimensional treatments, such as text or continuous variables, by recasting causal inference as a learning problem under realizability and no unobserved confounding. It shows that causal error can be decomposed into moment‑balancing errors of increasing order and designs objectives that directly improve causal estimation by exploiting the structure of conditional outcomes. The authors also demonstrate how to project high‑dimensional treatment effects onto coarser attributes, enabling a single model to answer multiple causal questions without extra attribute‑specific training, and validate their approach empirically across continuous, discrete, and text treatments.
arXiv:2507. 20993v4 Announce Type: replace-cross Abstract: We study how to learn treatment policies from multimodal electronic health records (EHRs) that consist of tabular data and clinical text.
The paper introduces new one‑step and targeted minimum loss‑based estimators for the average treatment effect and the average treatment effect on the treated under the front‑door criterion. These estimators use multiple parameterizations of the observed data distribution, can avoid modeling the mediator density, and are compatible with flexible machine‑learning nuisance estimation. The authors derive conditions for root‑n consistency, asymptotic linearity, and develop doubly robust tests for identification assumptions, demonstrating improved efficiency and favorable performance in simulations and real‑world applications in education and emergency medicine.
arXiv:2604. 23904v3 Announce Type: replace-cross Abstract: Synthetic tabular data are often evaluated by distributional similarity, privacy distance, or train-on-synthetic-test-on-real predictive performance, but these criteria do not ensure validity for causal inference.
ACTIVA is a transformer‑based conditional variational autoencoder designed to estimate full interventional distributions from observational data without requiring interventional data, a causal graph, or per‑task fitting. It learns a conditional latent prior that amortizes causal knowledge across diverse training tasks, enabling a single forward pass to handle new causal models drawn from the training distribution. Empirical results on synthetic and biologically realistic gene‑expression simulations show that ACTIVA outperforms correlational baselines, reduces spurious non‑descendant effects, and matches strong amortized baselines, while also validating its theoretical mixture‑of‑distributions property on observationally equivalent models.