arXiv Statistics ML

Doubly-robust causal inference for multi-valued treatment regimes with recurrent neural networks

arXiv Machine Learning
Jun 2

MedGym:A Unified Continuous-Time Benchmark for Dynamic Medical Treatment Reinforcement Learning

arXiv:2606. 01028v1 Announce Type: new Abstract: Medical treatment recommendation poses several challenges to reinforcement learning (RL): patient physiology evolves in continuous time, measurements and interventions are performed at irregular intervals, and treatment effects vary substantially across individuals.

By Yuepeng Wang, Ken Kawano, Yongqi Zhou, Yoshihiko Fujisawa, Richard Weiss, Akifumi Wachi, Katsuki Fujisawa, Ying Chen, Mehrshad Sadria, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Machine Learning
Sep 22

A Unified Benchmark for Dynamic Medical Treatment Reinforcement Learning

The paper introduces MedGym, a benchmark environment for dynamic medical treatment recommendation that models patient evolution in continuous time using Physics-Informed Neural Networks. It addresses gaps in existing reinforcement learning (RL) approaches by allowing evaluation of RL methods under irregular measurement intervals, personalized treatment responses, and safety considerations. MedGym enables direct comparison between discrete-time and continuous-time RL methods and supports clinically relevant metrics such as personalization and trajectory-level safety.

By Yuepeng Wang, Ken Kawano, Yoshihiko Fujisawa, Yongqi Zhou, Akifumi Wachi, Mehrshad Sadria, Lei Zhou, Richard Weiss, Katsuki Fujisawa, Ying Chen, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Statistics ML
Sep 28

Identifying Causal Effects Using a Single Proxy Variable

The paper tackles the problem of estimating causal effects when an unobserved confounder is present. It assumes a single, possibly multi‑dimensional proxy variable for the confounder and knowledge of the mechanism that generates this proxy. Under the Single Proxy Identifiability of Causal Effects (SPICE) assumption, the authors prove that the error mechanism is complete and causal effects are identifiable, extending prior proxy‑based results to continuous, multi‑dimensional settings and more flexible functional forms. They also introduce SPICE‑Net, a neural‑network‑based framework for estimating causal effects applicable to both discrete and continuous treatments.

By Silvan Vollmer, Niklas Pfister, Sebastian Weichwald
arXiv Machine Learning
Sep 4

Causal Foundation Models

Causal Foundation Models (CFMs) are pretrained neural networks designed to estimate causal quantities—such as the average treatment effect—across new datasets using in‑context learning, eliminating the need for bespoke pipelines or model updates. The paper introduces CFMs, reviews foundational concepts in causal inference and machine learning, and provides practical code examples and Jupyter notebooks to illustrate their application.

By Christopher Stith, Hossein Rahmani, Jesse C. Cresswell
arXiv Machine Learning
Oct 8

OrthoGen: A Generative Orthogonal Learner for Time-Varying Treatments

OrthoGen introduces a generative orthogonal learner for estimating conditional distributional potential outcomes (CDPOs) under time‑varying treatments, addressing challenges of time‑varying confounding. It combines a generative recursive g‑computation adjustment strategy with Neyman‑orthogonal, doubly robust learning, achieving rate double robustness and quasi‑oracle efficiency. The method is flexible, supporting various generative backbones, and demonstrates strong performance on synthetic, semi‑synthetic, and real‑world datasets.

By Tom\`as Garriga, Valentyn Melnychuk, Konstantin Hess, Eduard Serrahima de Cambra, Axel Brando, Gerard Sanz, Stefan Feuerriegel