arXiv Machine Learning

Supervised Learning Objectives for High-Dimensional Treatment Effects

The paper proposes supervised learning objectives for estimating causal effects of high‑dimensional treatments, such as text or continuous variables, by recasting causal inference as a learning problem under realizability and no unobserved confounding. It shows that causal error can be decomposed into moment‑balancing errors of increasing order and designs objectives that directly improve causal estimation by exploiting the structure of conditional outcomes. The authors also demonstrate how to project high‑dimensional treatment effects onto coarser attributes, enabling a single model to answer multiple causal questions without extra attribute‑specific training, and validate their approach empirically across continuous, discrete, and text treatments.

arXiv Machine Learning
Sep 4

Causal Foundation Models

Causal Foundation Models (CFMs) are pretrained neural networks designed to estimate causal quantities—such as the average treatment effect—across new datasets using in‑context learning, eliminating the need for bespoke pipelines or model updates. The paper introduces CFMs, reviews foundational concepts in causal inference and machine learning, and provides practical code examples and Jupyter notebooks to illustrate their application.

By Christopher Stith, Hossein Rahmani, Jesse C. Cresswell
arXiv Machine Learning
Aug 4

Causal Inference with Unstructured Treatments

arXiv:2608. 00657v1 Announce Type: cross Abstract: Causal inference usually concerns a scalar treatment, yet in many problems the treatment is unstructured: a text, an image, or a sequence of clinical decisions.

By Kevin Christian Wibisono, Yixin Wang
arXiv Statistics ML
Sep 28

Identifying Causal Effects Using a Single Proxy Variable

The paper tackles the problem of estimating causal effects when an unobserved confounder is present. It assumes a single, possibly multi‑dimensional proxy variable for the confounder and knowledge of the mechanism that generates this proxy. Under the Single Proxy Identifiability of Causal Effects (SPICE) assumption, the authors prove that the error mechanism is complete and causal effects are identifiable, extending prior proxy‑based results to continuous, multi‑dimensional settings and more flexible functional forms. They also introduce SPICE‑Net, a neural‑network‑based framework for estimating causal effects applicable to both discrete and continuous treatments.

By Silvan Vollmer, Niklas Pfister, Sebastian Weichwald
arXiv Machine Learning
Aug 5

Causal Inference with Unstructured Outcomes

arXiv:2608. 03085v1 Announce Type: cross Abstract: Causal inference has traditionally centered on scalar outcomes: whether a patient recovers, how much a worker earns, or how many visits a website receives.

By Kevin Christian Wibisono, Yixin Wang
arXiv Statistics ML
Aug 24

Double Machine Learning of Continuous Treatment Effects with Additive Instrumental Variables

The paper introduces a new framework for identifying average dose-response functions in the presence of unmeasured confounding by using instrumental variables. It defines a uniform regular weighting function and partitions the treatment space into open sets where local identification is possible. For estimation, the authors propose an augmented inverse probability weighted score within a debiased machine learning setting, along with practical guidance for constructing weighting functions, falsification tests for the additive IV condition, and asymptotic theory for kernel regression or empirical risk minimization estimators.

By Shuyuan Chen, Peng Zhang, Yifan Cui