arXiv:2606. 19481v1 Announce Type: new Abstract: Offline reinforcement learning (ORL) offers the potential to improve the quality of clinical decision-making using historical electronic health record (EHR) data.
By Thomas Frost, Steve Harris
arXiv:2606. 01028v1 Announce Type: new Abstract: Medical treatment recommendation poses several challenges to reinforcement learning (RL): patient physiology evolves in continuous time, measurements and interventions are performed at irregular intervals, and treatment effects vary substantially across individuals.
By Yuepeng Wang, Ken Kawano, Yongqi Zhou, Yoshihiko Fujisawa, Richard Weiss, Akifumi Wachi, Katsuki Fujisawa, Ying Chen, Mehrshad Sadria, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
The paper introduces PAFIR, a Personalized and Adaptive Feature selection framework that treats feature selection as a reinforcement learning problem over longitudinal multimodal health data. PAFIR jointly models structural dependencies among assessment variables and temporal dynamics in wearable-derived physical activity data, learning adaptive selection policies across repeated study visits using reward signals from sparse fall incidence outcomes. Applied to the Physio Feedback Exercise Program (PEER) trial, PAFIR outperforms state‑of‑the‑art baselines by capturing longitudinal and structural patterns of feature relevance, enabling dynamic, subject‑specific feature selection for more timely fall prevention strategies.
By Chang Liu, Ladda Thiamwong, Yanjie Fu, Rui Xie
The paper introduces an evidence ladder for evaluating reinforcement learning (RL) in healthcare, outlining stages from problem formulation to lifecycle monitoring. It argues that success in historical data does not guarantee real‑world improvement and highlights assumptions and failure modes at each rung. The authors propose reporting practices to support cumulative evaluation and emphasize that RL should be tested as an intervention within a dynamic sociotechnical system.
By Yunfan Zhao
The paper introduces MedGym, a benchmark environment for dynamic medical treatment recommendation that models patient evolution in continuous time using Physics-Informed Neural Networks. It addresses gaps in existing reinforcement learning (RL) approaches by allowing evaluation of RL methods under irregular measurement intervals, personalized treatment responses, and safety considerations. MedGym enables direct comparison between discrete-time and continuous-time RL methods and supports clinically relevant metrics such as personalization and trajectory-level safety.
By Yuepeng Wang, Ken Kawano, Yoshihiko Fujisawa, Yongqi Zhou, Akifumi Wachi, Mehrshad Sadria, Lei Zhou, Richard Weiss, Katsuki Fujisawa, Ying Chen, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv:2608. 15309v1 Announce Type: new Abstract: Continuous multimodal sensing now allows human physiology to be observed throughout daily life rather than only during occasional clinical visits.
By Chongyang Zhang, Rendong Wang, Hao Zheng, Hanwen Zhang, Yang Liu, Xiaolong Wei, Bin Chong
arXiv:2607. 06954v1 Announce Type: new Abstract: Wearable and mobile sensing technologies have demonstrated strong potential for health inference; however, most sensor models are designed for specific disease types, limiting their transferability across different health risks.
By Zhenghuang Wu, Yuyao Zhu, Songlin Xu
Wearable and mobile sensing technologies have demonstrated strong potential for health inference; however, most sensor models are designed for specific disease types, limiting their transferability across different health risks. Wearable foundation models offer a more generalizable approach in diverse health risk types.
The paper introduces CNA, an AI‑oriented comprehensive normalized assessment that transforms vital‑sign distributions into a standard normal space to produce a unified health‑status score. This score serves as a criterion for evaluating and terminating reinforcement learning policies in Renal Replacement Therapy (RRT). Using a 23‑dimensional state representation and matrix decomposition to handle missing data, the authors apply offline RL algorithms and show that the learned strategy reduces mortality from 13.2% to 5.0% and shortens hospital stays by nearly 59 hours compared to physician‑observed treatments.
By Jiang Liu, Chan Zhou, Yujie Li, Di Wu, Yihao Xie, Peiwei Li, Xin Shu, Jiaqi Zhu, Chunyong Yang, Yuwen Chen, Bin Yi
arXiv:2606. 06800v1 Announce Type: cross Abstract: Mental health struggles wax and wane, yet clinical and wellness interventions typically operate separately, causing frequent breakdowns at care transitions.
By Tony Wang, Qian Yang
arXiv:2607. 16235v1 Announce Type: cross Abstract: Mobile and wearable devices offer an unprecedented opportunity for continuous, passive health monitoring and active health coaching.
By Narayan Schuetz, Yuze Bai, Lianggang Pan, Edgar Eggert, Favour Nerrise, Juan Delgado-SanMartin, Max Rosenblattl, Milana Gurbanova, Mohammad Asadi, Anders Johnson, Paul Schmiedmayer, Dennis Wang, Allan Lawrie, Daniel Seung Kim, Xin Liu, Akshay Paruchuri, Ehsan Adeli, Euan Ashley, Kelly W. Zhang
arXiv:2605. 22759v2 Announce Type: replace Abstract: While ubiquitous wearable sensors capture a wealth of behavioral and physiological information, effectively transforming these signals into personalized health insights is challenging.
By Girish Narayanswamy, Maxwell A. Xu, A. Ali Heydari, Samy Abdel-Ghaffar, Marius Guerard, Kara Vaillancourt, Zhihan Zhang, Jake Garrison, Levi Albuquerque, Dimitris Spathis, Hong Yu, Hamid Palangi, Xuhai "Orson" Xu, David G. T. Barrett, Joseph Breda, Jed McGiffin, Yubin Kim, Yuwei Zhang, Naghmeh Rezaei, Samuel Solomon, Karan Ahuja, Tim Althoff, Jake Sunshine, Ming-Zher Poh, Benjamin Yetton, Ari Winbush, Nicholas B. Allen, James M. Rehg, Isaac Galatzer-Levy, Yun Liu, John Hernandez, Anupam Pathak, Conor Heneghan, Yuzhe Yang, Ahmed A. Metwally, Pushmeet Kohli, Mark Malhotra, Shwetak Patel, Xin Liu, Daniel McDuff