arXiv AI

CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts

arXiv:2606. 13024v1 Announce Type: cross Abstract: Granger Causal Discovery (GCD) is fundamental for analyzing temporal dependencies in complex systems.

arXiv Machine Learning
Jun 26

Use What You Know: Causal Foundation Models with Partial Graphs

arXiv:2602. 14972v2 Announce Type: replace Abstract: Estimating causal quantities traditionally relies on bespoke estimators tailored to specific assumptions.

By Arik Reuter, Anish Dhir, Cristiana Diaconu, Jake Robertson, Ole Ossen, Frank Hutter, Adrian Weller, Mark van der Wilk, Bernhard Sch\"olkopf
arXiv Machine Learning
Aug 19

Causal Local States: Scalable Simultaneous Causal Network Inference and Forecasting for Dynamical Systems

The paper introduces Causal Local States (CLS), a framework that simultaneously infers an approximate Granger‑causal interaction network and forecasts the dynamics of a system. CLS selects, for each node, the smallest set of neighbors that enables near‑optimal prediction, and then combines these local neighborhoods to forecast the entire system. Experiments on three increasingly difficult benchmarks show that CLS reconstructs the underlying networks with high fidelity and achieves forecast accuracy comparable to a model that uses the true network.

By Jonas Braun, Fabian Fischbach, Daniel K\"oglmayr, Sebastian Baur, Christoph R\"ath
arXiv Machine Learning
Aug 19

TabCausal: Pretraining Across Causal Environments for Tabular Causal Discovery

TabCausal is a causal discovery foundation model that learns to map datasets directly to causal graphs by pretraining across diverse causal environments. It uses a dynamic task construction strategy to expose the model to varied graph priors, mechanisms, noise models, dimensions, sample sizes, and intervention regimes, improving transferability from observational and mixed‑interventional data. On large synthetic benchmarks and a new protocol‑guided semantic benchmark, TabCausal outperforms many classical baselines and shows robust structure recovery, especially when interventional evidence is available.

By Zi-Rong Li, Si-Yang Liu, Tian-Zuo Wang, Han-Jia Ye
arXiv Machine Learning
Jul 14

DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanisms

arXiv:2607. 11510v1 Announce Type: new Abstract: Causal discovery from observational tabular data remains fundamentally challenging, primarily due to the heterogeneity of underlying causal mechanisms and the high-dimensional combinatorial search space of Directed Acyclic Graphs (DAGs).

By Yikang Chen, Zhengkang Guan, Haoyuan Qian, Peng Cui, Yi Yang, Kun Kuang
arXiv Statistics ML
Aug 25

Neuro-Causal Factor Analysis

Neuro-Causal Factor Analysis (NCFA) reimagines traditional factor analysis by integrating causal structure learning and deep generative modeling. The method learns a directed graph linking latent and observed variables, then trains a deep generative model that respects the graph’s Markov factorization. Experiments on synthetic and real datasets show NCFA achieves lower reconstruction error than standard FA and better latent distribution recovery than a variational autoencoder, while offering a sparser architecture, reduced complexity, and causal interpretability.

By Alex Markham, Mingyu Liu, Bryon Aragam, Liam Solus