arXiv Machine Learning

Evaluating Type-1 Diabetes Digital Twins by Decision Quality

The paper evaluates digital twins (DTs) for type‑1 diabetes by measuring how well they rank insulin treatments, rather than just predicting glucose trajectories. Using 30 virtual patients and 21 basal‑bolus regimens, the authors compare six DT methods, finding that a simple average‑patient model, despite low prediction accuracy, ranks treatments better than a highly accurate neural network. The study demonstrates that prediction accuracy does not guarantee useful treatment recommendations, underscoring the need to assess decision quality directly.

arXiv AI
Oct 28

Reliability-Aware Short-Term Glycemic Risk Prediction Using an Anchor-Based Comparative Framework of Sequence, Multimodal, and State-Updating Digital-Twin Models

The paper presents a reliability‑aware benchmarking framework for short‑term glycemic risk prediction, using 5,503,441 prediction anchors from 736 type‑1 diabetes patients. Three neural models—a Hybrid LSTM‑Transformer, a Multimodal Digital Twin, and a State‑Updating Digital Twin—were evaluated on 30‑, 60‑, and 120‑minute horizons for hypoglycemia and hyperglycemia, with identical patient‑level validation. While no significant differences in predictive accuracy were found, the models displayed distinct reliability traits: the Multimodal Digital Twin had the lowest Brier score, the State‑Updating Digital Twin the lowest expected calibration error, and the Hybrid LSTM‑Transformer the strongest explanation faithfulness.

By Pir Bakhsh Khokhar, Carmine Gravino, Fabio Palomba
arXiv AI
Aug 20

FairGlucose: A CGM Fairness Benchmark Reveals Subgroup Disparities Hidden in Population-Level Validation

FairGlucose is a 300‑patient CGM cohort balanced across 12 demographic strata, providing 132,480 forecasting samples and 3,945 behavioral events. Benchmarking 33 models on 2‑hour glucose forecasting revealed that population‑level validation masks significant subgroup disparities, with error ratios ranging from 0.8 to 1.4 and T1D patients experiencing 6 mg/dL higher error than T2D. The study shows that these gaps persist across all models, align with clinically hard cases, and vary with input‑length sensitivity, underscoring the need for subgroup‑disaggregated reporting in digital health AI.

By Junjie Luo, Xuzhe Zhi, Rui Han, Abhimanyu Kumbara, Anand K. Iyer, Mansur E. Shomali, Ritu Agarwal, Guodong Gordon Gao
arXiv Machine Learning
Oct 16

The impact of temporal resampling on the safety of clinical reinforcement learning: A simulated trial

The study examines how temporal resampling (binning) of irregular clinical data affects the safety and performance of offline reinforcement learning (ORL) models in healthcare. By analyzing MIMIC‑IV insulin infusion records, the authors show that binning can reverse causal order and obscure critical events. In simulated trials with virtual type‑1 diabetes patients, ORL models trained on binned data performed up to 60% worse than those trained on unprocessed data, yet retrospective evaluation on resampled data overestimated their returns.

By Thomas Frost, Hrisheekesh Vaidya, Steve Harris
arXiv Machine Learning
Oct 16

PMB-NN: Physiological-Model-Based Neural Network for Glucose Forecasting in Type 1 Diabetes

The study introduces PMB‑NN, a physiological‑model‑based neural network that forecasts glucose levels in type 1 diabetes using a temporal convolutional network trained on 180 minutes of historical data and constrained by a personalized four‑parameter physiological model. Evaluated on 6–8 weeks of continuous glucose monitoring, pump, and meal data from 25 participants, PMB‑NN achieved median mean absolute errors of 16.24, 25.00, and 30.20 mg/dL for 30‑, 60‑, and 120‑minute horizons when basal insulin records were available, outperforming the physiological model alone across all settings. The model also demonstrated expected directional changes for most correction boluses and carbohydrate rescues, and its three‑term variant improved hyperglycaemia accuracy with basal records without significantly altering overall error.

By Yaowen Zhang, Shuhao Que, Ying Wang
arXiv AI
Sep 3

The Ceiling Is in the Channel: Auditing Learner Gaps and Measurement Frontiers in Clinical Prediction

The paper introduces a framework that distinguishes two causes of saturation in clinical prediction: a learner gap, where the model fails to use available information, and a measurement‑channel ceiling, where the recorded variables limit performance. It provides theoretical characterizations, finite‑sample diagnostics, and empirical audits across three large cohorts, showing that well‑tuned models approach the frontier while deficient learners leave large gaps. A PRISMA‑guided synthesis across 104 tasks reveals consistent channel‑level patterns, suggesting that improving the learner or the measurement channel can audit and potentially lift performance.

By Sayeed Shafayet Chowdhury, Nusrat Jahan, Snehasis Mukhopadhyay, Shiaofen Fang, Vijay R. Ramakrishnan
arXiv Machine Learning
Jun 8

GlucoFM-Bench: Benchmarking Time-Series Foundation Models for Blood Glucose Forecasting

arXiv:2606. 06881v1 Announce Type: new Abstract: Blood glucose forecasting models are foundational for modern diabetes management systems, as reliable short-term predictions can enable proactive interventions, support automated insulin delivery, and reduce the risk of hypo- and hyperglycemic events.

By Baiying Lu, Zhaohui Liang, Ryan Pontius, Shengpu Tang, Temiloluwa Prioleau
arXiv AI
Jul 21

Comprehensive Evaluation of Machine Learning for Type 2 Diabetes Risk Prediction: Large-Scale External Validation and Fairness Analysis

arXiv:2607. 16253v1 Announce Type: cross Abstract: Machine learning-based Type 2 diabetes risk prediction models obtain good internal validation results but lose effectiveness in real-world applications due to deficient external testing and fairness assessment.

By Rajveer Singh Pall, Sameer Yadav, Siddharth Bhalerao, Sourabh Sahu, Ritu Ahluwalia, Bhaskar Awadhiya