arXiv Machine Learning
Jun 2

MedGym:A Unified Continuous-Time Benchmark for Dynamic Medical Treatment Reinforcement Learning

arXiv:2606. 01028v1 Announce Type: new Abstract: Medical treatment recommendation poses several challenges to reinforcement learning (RL): patient physiology evolves in continuous time, measurements and interventions are performed at irregular intervals, and treatment effects vary substantially across individuals.

By Yuepeng Wang, Ken Kawano, Yongqi Zhou, Yoshihiko Fujisawa, Richard Weiss, Akifumi Wachi, Katsuki Fujisawa, Ying Chen, Mehrshad Sadria, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Machine Learning
Sep 22

A Unified Benchmark for Dynamic Medical Treatment Reinforcement Learning

The paper introduces MedGym, a benchmark environment for dynamic medical treatment recommendation that models patient evolution in continuous time using Physics-Informed Neural Networks. It addresses gaps in existing reinforcement learning (RL) approaches by allowing evaluation of RL methods under irregular measurement intervals, personalized treatment responses, and safety considerations. MedGym enables direct comparison between discrete-time and continuous-time RL methods and supports clinically relevant metrics such as personalization and trajectory-level safety.

By Yuepeng Wang, Ken Kawano, Yoshihiko Fujisawa, Yongqi Zhou, Akifumi Wachi, Mehrshad Sadria, Lei Zhou, Richard Weiss, Katsuki Fujisawa, Ying Chen, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Statistics ML
Sep 28

Identifying Causal Effects Using a Single Proxy Variable

The paper tackles the problem of estimating causal effects when an unobserved confounder is present. It assumes a single, possibly multi‑dimensional proxy variable for the confounder and knowledge of the mechanism that generates this proxy. Under the Single Proxy Identifiability of Causal Effects (SPICE) assumption, the authors prove that the error mechanism is complete and causal effects are identifiable, extending prior proxy‑based results to continuous, multi‑dimensional settings and more flexible functional forms. They also introduce SPICE‑Net, a neural‑network‑based framework for estimating causal effects applicable to both discrete and continuous treatments.

By Silvan Vollmer, Niklas Pfister, Sebastian Weichwald