arXiv Statistics ML By Xiangyu Yu, Weiyu Liu

Design-Ignoring versus Design-Respecting World Models for Epidemiology

Read the original on arXiv Statistics ML →

The paper contrasts design-ignoring and design-respecting world models for epidemiology, formalizing study design as constraints on a model’s latent-world interface, action mechanism, observation likelihood, and target readout. Using a large cluster-randomized test-negative trial, the authors compare a design-ignoring case-count model with a design-respecting test-negative observation model, finding that while both reconstruct factual trajectories similarly, the design-ignoring model’s intervention contrasts vary substantially across resampling experiments, whereas the design-respecting model’s contrasts remain stable. The study demonstrates that factual reconstruction alone does not guarantee alignment with study design, and that evaluating whether fitted contrasts preserve design-implied observation-process invariances offers a more precise assessment.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Oct 23

When Reconstruction Is Not Enough: Doubly Robust Counterfactual and Interventional Mediation Analysis with Learned Multimodal Representations

The paper investigates how learned multimodal representations of high‑dimensional health data can fail to preserve causal information, even when trained to reconstruct the data. It establishes conditions under which a representation is sufficient for causal identification, shows that interventional mediation requires stricter preservation than counterfactual comparison, and proves that reconstruction‑based objectives cannot certify sufficiency. The authors decompose the error of cross‑fitted doubly robust estimators into a first‑order representation bias and a second‑order nuisance‑estimation remainder, demonstrating that coverage can deteriorate with larger samples if the representation is insufficient. They propose a practical workflow that combines modality‑specific variational autoencoders, cross‑fitted doubly robust estimation, locked phenotypes, selective pathway analysis, portable representations, and diagnostics for representation insufficiency, exposure leakage, and sensitivity, and validate it in simulations where a rare confounder’s omission leads to severely under‑covered indirect‑effect intervals.

By Cong Cao
arXiv Machine Learning
Oct 2

CIDER-FM: Foundation Models for Causal Inference from Diverse Experimental Regimes

CIDER-FM is a causal foundation model that combines finite observational data with surrogate-interventional datasets to predict target conditional interventional distributions more accurately than using observational data alone. It employs an intervention-aware representation and hierarchical three‑axis attention to integrate information across variables, samples, and experimental regimes. Experiments on synthetic graphs, simulated data, and real‑world Causal Chambers data show that incorporating experimental context improves CID prediction performance.

By Yuche Gao, Arik Reuter, Siyuan Guo, Anish Dhir, Bernhard Sch\"olkopf, Adrian Weller
arXiv Machine Learning
Sep 21

Intervention Granularity Matters: Coherent Treatment Bundles in Counterfactual Simulation with Clinical World Models

The paper investigates how the granularity of interventions—single components versus full treatment bundles—affects counterfactual simulations using a clinical world model. By analyzing 945,707 patient-hours from MIMIC-IV, the authors show that interventions are naturally bundled, and editing a single component often represents an unreal scenario. Experiments with Clin‑JEPA on 1,019 ventilation onsets demonstrate that editing the complete bundle produces larger predicted state changes than editing individual settings, indicating that bundle-aware editing better captures treatment sensitivity.

By Fangzhou Wang, Yixuan Yang, Camilla Balzarotti, Rishikesan Kamaleswaran