arXiv:2606. 01028v1 Announce Type: new Abstract: Medical treatment recommendation poses several challenges to reinforcement learning (RL): patient physiology evolves in continuous time, measurements and interventions are performed at irregular intervals, and treatment effects vary substantially across individuals.
By Yuepeng Wang, Ken Kawano, Yongqi Zhou, Yoshihiko Fujisawa, Richard Weiss, Akifumi Wachi, Katsuki Fujisawa, Ying Chen, Mehrshad Sadria, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
The paper introduces MedGym, a benchmark environment for dynamic medical treatment recommendation that models patient evolution in continuous time using Physics-Informed Neural Networks. It addresses gaps in existing reinforcement learning (RL) approaches by allowing evaluation of RL methods under irregular measurement intervals, personalized treatment responses, and safety considerations. MedGym enables direct comparison between discrete-time and continuous-time RL methods and supports clinically relevant metrics such as personalization and trajectory-level safety.
By Yuepeng Wang, Ken Kawano, Yoshihiko Fujisawa, Yongqi Zhou, Akifumi Wachi, Mehrshad Sadria, Lei Zhou, Richard Weiss, Katsuki Fujisawa, Ying Chen, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv:2605. 15133v2 Announce Type: replace Abstract: Causal inference, estimating causal effects from observational data, is a fundamental tool in many disciplines.
By Christopher Stith, Medha Barath, Vahid Balazadeh, Jesse C. Cresswell, Rahul G. Krishnan
The paper tackles the problem of estimating causal effects when an unobserved confounder is present. It assumes a single, possibly multi‑dimensional proxy variable for the confounder and knowledge of the mechanism that generates this proxy. Under the Single Proxy Identifiability of Causal Effects (SPICE) assumption, the authors prove that the error mechanism is complete and causal effects are identifiable, extending prior proxy‑based results to continuous, multi‑dimensional settings and more flexible functional forms. They also introduce SPICE‑Net, a neural‑network‑based framework for estimating causal effects applicable to both discrete and continuous treatments.
By Silvan Vollmer, Niklas Pfister, Sebastian Weichwald
arXiv:2607. 22762v1 Announce Type: cross Abstract: Causal inference has become a central issue across various fields, including computer science, statistics, economics, education, healthcare, and medicine.
By Ali Haghpanah Jahromi, Mohammad Taheri, Zohreh Azimifar
arXiv:2604.26070v3 Announce Type: replace
Abstract: Causal inference in continuous-time sequential decision problems is challenged by hidden confounding and partially observed states. We show that, u...
By Jennifer Wendland, Nicolas Freitag, Maik Kschischo
arXiv:2507. 20993v4 Announce Type: replace-cross Abstract: We study how to learn treatment policies from multimodal electronic health records (EHRs) that consist of tabular data and clinical text.
By Henri Arno, Thomas Demeester
Causal Foundation Models (CFMs) are pretrained neural networks designed to estimate causal quantities—such as the average treatment effect—across new datasets using in‑context learning, eliminating the need for bespoke pipelines or model updates. The paper introduces CFMs, reviews foundational concepts in causal inference and machine learning, and provides practical code examples and Jupyter notebooks to illustrate their application.
By Christopher Stith, Hossein Rahmani, Jesse C. Cresswell
arXiv:2606. 05797v1 Announce Type: new Abstract: Longitudinal treatment decisions require predicting potential outcomes under future treatment sequences in the presence of time-varying confounding, heterogeneous patient dynamics, and limited domain-specific data.
By Amirhossein Zare, Amirhessam Zare, Herlock Rahimi, Reza Salarikia, Mohammad Kashkooli
arXiv:2609.06294v1 Announce Type: new
Abstract: Estimating conditional average treatment effects (CATE) enables efficient targeting of interventions, but many applications have limited experimental s...
By Maitreyi Swaroop, Shikha Bhat, Samantha Rodriguez, Tamar Krishnamurti, Bryan Wilder
OrthoGen introduces a generative orthogonal learner for estimating conditional distributional potential outcomes (CDPOs) under time‑varying treatments, addressing challenges of time‑varying confounding. It combines a generative recursive g‑computation adjustment strategy with Neyman‑orthogonal, doubly robust learning, achieving rate double robustness and quasi‑oracle efficiency. The method is flexible, supporting various generative backbones, and demonstrates strong performance on synthetic, semi‑synthetic, and real‑world datasets.
By Tom\`as Garriga, Valentyn Melnychuk, Konstantin Hess, Eduard Serrahima de Cambra, Axel Brando, Gerard Sanz, Stefan Feuerriegel
arXiv:2604. 23107v2 Announce Type: replace-cross Abstract: Causal effect estimation from observational data requires careful adjustment for confounding.
By Lei Wang, Debashis Ghosh