arXiv Machine Learning
Jul 14
Causal Foundation Models with Continuous Treatments
arXiv:2605. 15133v2 Announce Type: replace Abstract: Causal inference, estimating causal effects from observational data, is a fundamental tool in many disciplines.
Causal Foundation Models
Causal Foundation Models (CFMs) are pretrained neural networks designed to estimate causal quantities—such as the average treatment effect—across new datasets using in‑context learning, eliminating the need for bespoke pipelines or model updates. The paper introduces CFMs, reviews foundational concepts in causal inference and machine learning, and provides practical code examples and Jupyter notebooks to illustrate their application.
Related stories
arXiv Machine Learning
1d ago
What You Observe Determines How You Identify Causal Effects: Evaluating Causal Models across Observational Views
arXiv:2609.36881v1 Announce Type: new Abstract: Causal foundation models (CFMs) pre-trained on data generated from various structural causal models (SCMs) have been proposed for estimating causal eff...
arXiv Machine Learning
Jun 26
Use What You Know: Causal Foundation Models with Partial Graphs
arXiv:2602. 14972v2 Announce Type: replace Abstract: Estimating causal quantities traditionally relies on bespoke estimators tailored to specific assumptions.
arXiv Machine Learning
Jun 3
Tailoring Strictly Proper Scoring Rules for Downstream Tasks: An Application to Causal Inference
arXiv:2606. 03332v1 Announce Type: new Abstract: Probabilistic models are typically trained using task-agnostic objectives like log-loss, which can lead to significant errors in downstream estimation.
arXiv Machine Learning
Aug 4
Large Causal Models for Temporal Causal Discovery
arXiv:2602. 18662v2 Announce Type: replace Abstract: Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset.
arXiv AI
Aug 20
CausalProfiler: Generating Synthetic Benchmarks for Rigorous and Transparent Evaluation of Causal Machine Learning
CausalProfiler is a synthetic benchmark generator designed to evaluate causal machine learning (Causal ML) methods more rigorously and transparently. It randomly samples causal models, data, queries, and ground truths based on explicit design choices across observation, intervention, and counterfactual reasoning levels, providing coverage guarantees and transparent assumptions. The authors demonstrate its utility by testing several state‑of‑the‑art methods under diverse conditions, both within and outside the identification regime, highlighting the insights CausalProfiler can reveal.
Hugging Face Trending Papers
Jun 25
A Causal Foundation Model for Structure and Outcome Prediction
We introduce TabPFN-CFM, a causal foundation model that can handle multiple causal problems. TabPFN-CFM predicts both causal structure and outcomes from observational data, supports queries on all three levels of Pearl's Causal Hierarchy and uses known graph structure when available to improve predictions.
arXiv Machine Learning
Jul 7
MetaCaDI: A Meta-Learning Framework for Causal Discovery from Multiple Environments with Unknown Interventions
arXiv:2510. 22298v2 Announce Type: replace-cross Abstract: Uncovering the causal mechanisms of complex real-world systems remains a significant challenge, as these systems often entail high data collection costs and involve unknown interventions.
arXiv Machine Learning
Jun 26
A Causal Foundation Model for Structure and Outcome Prediction
arXiv:2606. 26467v1 Announce Type: new Abstract: We introduce TabPFN-CFM, a causal foundation model that can handle multiple causal problems.
arXiv Machine Learning
Sep 11
CausalArena: Benchmarking Causal Discovery in the Foundation Model Era
CausalArena is a new benchmark designed to evaluate causal discovery methods in the era of foundation models. It unifies synthetic structural causal models (SCMs), semantically grounded SCMs, and formula‑grounded SCMs, while also including real‑world datasets for external validation. Experiments show that performance rankings vary widely across different SCM families and protocols, indicating that strong results on one benchmark do not necessarily transfer to others.
Hugging Face Trending Papers
Jun 2
Tailoring Strictly Proper Scoring Rules for Downstream Tasks: An Application to Causal Inference
Probabilistic models are typically trained using task-agnostic objectives like log-loss, which can lead to significant errors in downstream estimation. This disconnect is especially critical in Inverse Probability Weighting (IPW) for causal inference, where propensity score errors near $0$ and $1$ often lead to high bias and variance.
arXiv Statistics ML
3d ago
Identifying Causal Effects Using a Single Proxy Variable
The paper tackles the problem of estimating causal effects when an unobserved confounder is present. It assumes a single, possibly multi‑dimensional proxy variable for the confounder and knowledge of the mechanism that generates this proxy. Under the Single Proxy Identifiability of Causal Effects (SPICE) assumption, the authors prove that the error mechanism is complete and causal effects are identifiable, extending prior proxy‑based results to continuous, multi‑dimensional settings and more flexible functional forms. They also introduce SPICE‑Net, a neural‑network‑based framework for estimating causal effects applicable to both discrete and continuous treatments.