arXiv Machine Learning

Context-Aware Optimization of Follow-Up Intervals for Type 2 Diabetes Care Using Markov Decision Processes

arXiv:2606. 19092v1 Announce Type: cross Abstract: Chronic disease management relies on regular patient-provider interactions to follow-up on disease progression and control.

arXiv Machine Learning
Jul 30

From Unsupervised Subgroups to Hypothetical State-Intervention Policies: An Evaluation of Selected Subgrouping Methods in Observational Health Data

arXiv:2607. 26521v1 Announce Type: new Abstract: Conventional subgroup analyses can yield unstable and difficult-to-interpret conclusions, especially in observational biomedical data where each individual is observed under only one exposure state, true individual treatment effects are unavailable, and causal structure is uncertain.

By Vasundhara Acharya, Bulent Yener
arXiv Machine Learning
5d ago

Peer-Grounded Counterfactual Path Planning for Chronic Health Management

The paper introduces POROS, a framework that uses peer‑grounded counterfactual explanations to generate incremental behavioral steps for chronic disease management. POROS builds a directed acyclic graph of patient states where each edge represents a behavior change that peers have successfully achieved and that improves health outcomes. In two diabetes cohorts, POROS reduces the required improvement per step from over 25–30 percentage points to about 5–6, while most multi‑hop paths involve cross‑patient comparisons.

By Saman Khamesian, Hassan Ghasemzadeh
arXiv Machine Learning
2d ago

Patient-Centered Treatment Planning for Chronic Multimorbidity: A Hierarchical Reinforcement Learning Framework for Preference Modeling

The paper introduces FAHOC, a hierarchical reinforcement learning framework that models patient preferences by learning high‑level therapeutic options and factored intra‑option policies, while enforcing a cooperation‑aware action masking mechanism. It demonstrates that cooperative patients achieve better health outcomes and that the Q‑function approximation error is bounded. Evaluated on data from ~50,000 comorbid hypertension and type 2 diabetes patients, FAHOC improves quality‑adjusted life years by 0.669, correctly identifies cooperative patients 95.9% of the time, and never violates patient preferences in held‑out tests.

By Nafiseh Payani, Soham Das, G. Anthony Wilson, Anahita Khojandi
arXiv Machine Learning
Jul 1

Teaching LLMs to Recommend and Defer in Underrepresented Epilepsy Care

arXiv:2606. 31036v1 Announce Type: new Abstract: Specialist epilepsy expertise is scarce in resource-constrained settings, making LLM-based decision support attractive for frontline clinicians managing longitudinal treatment.

By Shreyas Rajesh, Kartik Sharma, Tonmoy Monsoor, Mehmet Yigit Turali, Richard Idro, Juliana Kayaga, Robert Sebunya, Tracy Tushabe Namata, Jessica Nichole Pasqua, Vwani Roychowdhury, Rajarshi Mazumder
arXiv Machine Learning
Aug 11

Learning Multi-Timescale Interventions under Safety and Resource Constraints

arXiv:2508. 03875v2 Announce Type: replace Abstract: Many sequential decision problems offer qualitatively different ways of influencing the environment: some interventions act immediately, whereas others induce persistent effects that continue to shape future states long after the decision that initiated them.

By David Mguni, Wanrong Yang, Jing Dong, Ziquan Liu, Muhammad Salman Haleem, Baoxiang Wang, Dominik Wojtczak
arXiv Machine Learning
Aug 20

Adaptive Multi-Agent Feature Selection for Personalized Fall Risk Prevention

The paper introduces PAFIR, a Personalized and Adaptive Feature selection framework that treats feature selection as a reinforcement learning problem over longitudinal multimodal health data. PAFIR jointly models structural dependencies among assessment variables and temporal dynamics in wearable-derived physical activity data, learning adaptive selection policies across repeated study visits using reward signals from sparse fall incidence outcomes. Applied to the Physio Feedback Exercise Program (PEER) trial, PAFIR outperforms state‑of‑the‑art baselines by capturing longitudinal and structural patterns of feature relevance, enabling dynamic, subject‑specific feature selection for more timely fall prevention strategies.

By Chang Liu, Ladda Thiamwong, Yanjie Fu, Rui Xie
arXiv Machine Learning
Jun 2

Interaction-Limited Safe Continuous-Time RL for Dynamical Medical Treatment

arXiv:2606. 01051v1 Announce Type: new Abstract: Dynamic medical treatment requires deciding treatment intensity and intervention timing, while patient states evolve continuously and adverse events may occur between clinical interactions.

By Xun Shen, Yuepeng Wang, Akifumi Wachi, Yongqi Zhou, Richard Weiss, Yoshihiko Fujisawa, Ken Kawano, Mehrshad Sadria, Ying Chen, Xin Liu, Sebastien Gros, Xiao Hu, Kyoung-Sook Kim, Mengmou Li, Katsuki Fujisawa, Kenji Wakabayashi
arXiv Machine Learning
Jun 2

MedGym:A Unified Continuous-Time Benchmark for Dynamic Medical Treatment Reinforcement Learning

arXiv:2606. 01028v1 Announce Type: new Abstract: Medical treatment recommendation poses several challenges to reinforcement learning (RL): patient physiology evolves in continuous time, measurements and interventions are performed at irregular intervals, and treatment effects vary substantially across individuals.

By Yuepeng Wang, Ken Kawano, Yongqi Zhou, Yoshihiko Fujisawa, Richard Weiss, Akifumi Wachi, Katsuki Fujisawa, Ying Chen, Mehrshad Sadria, Xin Liu, Kyoung-Sook Kim, Xiao Hu, Sebastien Gros, Xun Shen
arXiv Machine Learning
Aug 26

A Structural FHMM for Interpretable Disease Trajectories in T2DM

arXiv:2608.24328v1 Announce Type: new Abstract: In this work, we propose a structural variant of the Factorial Hidden Markov Model (FHMM) for the analysis of disease trajectories in patients with Typ...

By Alessandro Mari, Ekaterina Krymova, Guillaume Obozinski, Maria Luisa Marques de Sa Faquetti, Adrian Martinez de la Torre, Andrea Burden
arXiv AI
Jun 16

Optimizing Health Coverage in Ethiopia: A Learning-augmented Approach and Persistent Proportionality Under an Online Budget

arXiv:2509. 00135v2 Announce Type: replace Abstract: As part of nationwide efforts aligned with the United Nations' Sustainable Development Goal 3 on Universal Health Coverage, Ethiopia's Ministry of Health is strengthening health posts to expand access to essential healthcare services.

By Davin Choo, Yohai Trabelsi, Fentabil Getnet, Samson Warkaye Lamma, Wondesen Nigatu, Kasahun Sime, Lisa Matay, Milind Tambe, St\'ephane Verguet