arXiv Machine Learning

Precision Physical Activity Prescription via Reinforcement Learning for Functional Actions

arXiv:2605. 19208v2 Announce Type: replace-cross Abstract: Physical activity (PA) plays an important role in maintaining and improving health.

arXiv Machine Learning
Jun 2

MedGym:A Unified Continuous-Time Benchmark for Dynamic Medical Treatment Reinforcement Learning

arXiv:2606. 01028v1 Announce Type: new Abstract: Medical treatment recommendation poses several challenges to reinforcement learning (RL): patient physiology evolves in continuous time, measurements and interventions are performed at irregular intervals, and treatment effects vary substantially across individuals.

By Yuepeng Wang, Ken Kawano, Yongqi Zhou, Yoshihiko Fujisawa, Richard Weiss, Akifumi Wachi, Katsuki Fujisawa, Ying Chen, Mehrshad Sadria, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Machine Learning
Aug 20

Adaptive Multi-Agent Feature Selection for Personalized Fall Risk Prevention

The paper introduces PAFIR, a Personalized and Adaptive Feature selection framework that treats feature selection as a reinforcement learning problem over longitudinal multimodal health data. PAFIR jointly models structural dependencies among assessment variables and temporal dynamics in wearable-derived physical activity data, learning adaptive selection policies across repeated study visits using reward signals from sparse fall incidence outcomes. Applied to the Physio Feedback Exercise Program (PEER) trial, PAFIR outperforms state‑of‑the‑art baselines by capturing longitudinal and structural patterns of feature relevance, enabling dynamic, subject‑specific feature selection for more timely fall prevention strategies.

By Chang Liu, Ladda Thiamwong, Yanjie Fu, Rui Xie
arXiv Machine Learning
Sep 22

The Evidence Ladder for Reinforcement Learning in Healthcare: From Retrospective Policies to Trusted Interventions

The paper introduces an evidence ladder for evaluating reinforcement learning (RL) in healthcare, outlining stages from problem formulation to lifecycle monitoring. It argues that success in historical data does not guarantee real‑world improvement and highlights assumptions and failure modes at each rung. The authors propose reporting practices to support cumulative evaluation and emphasize that RL should be tested as an intervention within a dynamic sociotechnical system.

By Yunfan Zhao
arXiv Machine Learning
Sep 22

A Unified Benchmark for Dynamic Medical Treatment Reinforcement Learning

The paper introduces MedGym, a benchmark environment for dynamic medical treatment recommendation that models patient evolution in continuous time using Physics-Informed Neural Networks. It addresses gaps in existing reinforcement learning (RL) approaches by allowing evaluation of RL methods under irregular measurement intervals, personalized treatment responses, and safety considerations. MedGym enables direct comparison between discrete-time and continuous-time RL methods and supports clinically relevant metrics such as personalization and trajectory-level safety.

By Yuepeng Wang, Ken Kawano, Yoshihiko Fujisawa, Yongqi Zhou, Akifumi Wachi, Mehrshad Sadria, Lei Zhou, Richard Weiss, Katsuki Fujisawa, Ying Chen, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Machine Learning
Sep 22

CNA: An AI-Oriented Comprehensive Normalized Assessment for Healthy Status and Application to Optimize RRT Strategies by Reinforcement Learning

The paper introduces CNA, an AI‑oriented comprehensive normalized assessment that transforms vital‑sign distributions into a standard normal space to produce a unified health‑status score. This score serves as a criterion for evaluating and terminating reinforcement learning policies in Renal Replacement Therapy (RRT). Using a 23‑dimensional state representation and matrix decomposition to handle missing data, the authors apply offline RL algorithms and show that the learned strategy reduces mortality from 13.2% to 5.0% and shortens hospital stays by nearly 59 hours compared to physician‑observed treatments.

By Jiang Liu, Chan Zhou, Yujie Li, Di Wu, Yihao Xie, Peiwei Li, Xin Shu, Jiaqi Zhu, Chunyong Yang, Yuwen Chen, Bin Yi
arXiv AI
Jul 21

OpenMHC: Accelerating the Science of Wearable Foundation Models

arXiv:2607. 16235v1 Announce Type: cross Abstract: Mobile and wearable devices offer an unprecedented opportunity for continuous, passive health monitoring and active health coaching.

By Narayan Schuetz, Yuze Bai, Lianggang Pan, Edgar Eggert, Favour Nerrise, Juan Delgado-SanMartin, Max Rosenblattl, Milana Gurbanova, Mohammad Asadi, Anders Johnson, Paul Schmiedmayer, Dennis Wang, Allan Lawrie, Daniel Seung Kim, Xin Liu, Akshay Paruchuri, Ehsan Adeli, Euan Ashley, Kelly W. Zhang
arXiv AI
Jun 2

Towards a General Intelligence and Interface for Wearable Health Data

arXiv:2605. 22759v2 Announce Type: replace Abstract: While ubiquitous wearable sensors capture a wealth of behavioral and physiological information, effectively transforming these signals into personalized health insights is challenging.

By Girish Narayanswamy, Maxwell A. Xu, A. Ali Heydari, Samy Abdel-Ghaffar, Marius Guerard, Kara Vaillancourt, Zhihan Zhang, Jake Garrison, Levi Albuquerque, Dimitris Spathis, Hong Yu, Hamid Palangi, Xuhai "Orson" Xu, David G. T. Barrett, Joseph Breda, Jed McGiffin, Yubin Kim, Yuwei Zhang, Naghmeh Rezaei, Samuel Solomon, Karan Ahuja, Tim Althoff, Jake Sunshine, Ming-Zher Poh, Benjamin Yetton, Ari Winbush, Nicholas B. Allen, James M. Rehg, Isaac Galatzer-Levy, Yun Liu, John Hernandez, Anupam Pathak, Conor Heneghan, Yuzhe Yang, Ahmed A. Metwally, Pushmeet Kohli, Mark Malhotra, Shwetak Patel, Xin Liu, Daniel McDuff