arXiv AI

Foundation Models for Partial Causal Identification

The paper introduces causal foundation models that can bound the effects of interventions and counterfactuals using only observational data. It defines a canonical prior with full support over structural causal models with discrete observables, enabling the translation of counterfactual bounding into learning distributions over functions that map data and structural assumptions to causal queries. This approach extends causal foundational modelling to partially-identifiable causal effects, where unobserved confounding leads to multiple compatible values for the effect.

arXiv Statistics ML
Sep 28

Identifying Causal Effects Using a Single Proxy Variable

The paper tackles the problem of estimating causal effects when an unobserved confounder is present. It assumes a single, possibly multi‑dimensional proxy variable for the confounder and knowledge of the mechanism that generates this proxy. Under the Single Proxy Identifiability of Causal Effects (SPICE) assumption, the authors prove that the error mechanism is complete and causal effects are identifiable, extending prior proxy‑based results to continuous, multi‑dimensional settings and more flexible functional forms. They also introduce SPICE‑Net, a neural‑network‑based framework for estimating causal effects applicable to both discrete and continuous treatments.

By Silvan Vollmer, Niklas Pfister, Sebastian Weichwald
arXiv Machine Learning
Sep 22

Causal Inference with Unobserved Confounding: A Mixture Learning Perspective

The paper introduces a mixture‑learning framework for causal inference with unobserved confounding, treating latent confounders as sources of heterogeneity that create mixture structures in observed data. By assuming suitable structural and identifiability conditions, it shows that recovering the mixing distribution and component mechanisms allows estimation of interventional distributions and causal estimands. The authors illustrate the approach with Bernoulli mixture examples, extend it to high‑dimensional exponential‑family mixtures with dependent outcomes, and relate it to panel‑data settings, latent factor models, and synthetic interventions.

By Mansi Sood, Devavrat Shah
arXiv AI
Aug 26

Partial Identification under Causal Orders by Linear Programming

The paper presents a method for partially identifying counterfactual queries without requiring a fully specified causal graph. By exploiting the topological ordering implied by the query itself, the authors transform the identification problem into a linear programming task, enabling bounds on arbitrary counterfactual and nested counterfactual queries. They demonstrate the tightness of these bounds and illustrate the approach on several case studies, showing its usefulness even when causal knowledge is incomplete.

By Eric Rossetto, Alessandro Antonucci
arXiv Machine Learning
1d ago

Structural Causal Bottleneck Models

arXiv:2603.08682v3 Announce Type: replace-cross Abstract: We introduce structural causal bottleneck models (SCBMs), a novel class of structural causal models in which causal effects between high-dime...

By Simon Bing, Jonas Wahl, Jakob Runge
arXiv Machine Learning
Sep 4

Causal Foundation Models

Causal Foundation Models (CFMs) are pretrained neural networks designed to estimate causal quantities—such as the average treatment effect—across new datasets using in‑context learning, eliminating the need for bespoke pipelines or model updates. The paper introduces CFMs, reviews foundational concepts in causal inference and machine learning, and provides practical code examples and Jupyter notebooks to illustrate their application.

By Christopher Stith, Hossein Rahmani, Jesse C. Cresswell
arXiv Machine Learning
Jun 26

Use What You Know: Causal Foundation Models with Partial Graphs

arXiv:2602. 14972v2 Announce Type: replace Abstract: Estimating causal quantities traditionally relies on bespoke estimators tailored to specific assumptions.

By Arik Reuter, Anish Dhir, Cristiana Diaconu, Jake Robertson, Ole Ossen, Frank Hutter, Adrian Weller, Mark van der Wilk, Bernhard Sch\"olkopf
arXiv Machine Learning
4d ago

Supervised Learning Objectives for High-Dimensional Treatment Effects

The paper proposes supervised learning objectives for estimating causal effects of high‑dimensional treatments, such as text or continuous variables, by recasting causal inference as a learning problem under realizability and no unobserved confounding. It shows that causal error can be decomposed into moment‑balancing errors of increasing order and designs objectives that directly improve causal estimation by exploiting the structure of conditional outcomes. The authors also demonstrate how to project high‑dimensional treatment effects onto coarser attributes, enabling a single model to answer multiple causal questions without extra attribute‑specific training, and validate their approach empirically across continuous, discrete, and text treatments.

By Nikita Dhawan, Arnav Paruthi, Andrew Kim, Lovedeep Gondara, Jekaterina Novikova, Chris J. Maddison