ReClaim is a family of generative foundation models trained on 43.8 billion administrative claims from over 200 million enrollees in the MarketScan Research Databases. The models jointly learn diagnoses, procedures, medications, and expenditures, and outperform disease‑specific gradient‑boosted models and transformer baselines in predicting more than 1,000 diseases, forecasting next‑year expenditure, and identifying high‑need, high‑cost enrollees. ReClaim’s representations also improve effect estimates in real‑world evidence studies compared with algorithm‑derived covariates, demonstrating the value of nationwide insurance claims as a scalable substrate for healthcare foundation models.
arXiv:2505. 16941v4 Announce Type: replace-cross Abstract: Foundation models (FMs) promise to address core limitations of traditional supervised machine learning: (i) reliance on large amounts of labeled data, (ii) task specificity, and (iii) poor transportability.
The paper introduces a compact patient world model that forecasts digital health campaign outcomes by maintaining a latent state per patient and learning exposure‑conditioned dynamics. Evaluated on a large US campaign dataset, the model predicts new‑to‑brand prescription volume with low relative error (2.9% at week‑4 cutoff) compared to much higher errors from baseline classifiers. The study also shows that dense next‑exposure supervision is crucial for accurate forecasts when conversions are rare and highlights limitations in interpreting exposure‑conditioned rollouts causally.
arXiv:2608. 16273v1 Announce Type: cross Abstract: Foresight-England (Foresight-E) is the first national-scale generative foundation model of electronic health records (EHRs), developed as a research pilot strictly for COVID-19 research.
arXiv:2608. 12805v1 Announce Type: new Abstract: Access to clinical data is essential for developing reliable healthcare machine learning systems, but direct use of electronic health records is constrained by privacy regulation, institutional review, data-use agreements, and the risk of re-identification.
The paper introduces ICD-Deepresearch, a workflow that combines foundation models for electronic health records (EHR) and language models with medical search and ICD dictionaries to forecast future ICD codes for upcoming clinical encounters. It evaluates candidate code transitions by linking patient evidence, external clinical relations, and exact code semantics within a fixed top‑K budget, using SparseEHR for initial priors, GPT‑5 for complementary forecasts, and a final selection step that validates, deduplicates, and ranks candidates. The method achieves patient‑averaged precision/recall of 24.60/35.09% on MIMIC‑III and 25.14/48.32% on MIMIC‑IV, with physicians rating 51–68% of its retrieved documents as useful, outperforming standalone GPT‑5 web search and Medical Deep Research.
The paper introduces the General Demographic Pre-trained (GDP) model, a lightweight foundation model that learns representations from the two most common clinical attributes—age and sex. By optimizing encoding and visit‑reordering strategies, GDP embeddings are shown to improve predictive performance when concatenated with raw features across various disease and geographic cohorts. The model outperforms several state‑of‑the‑art tabular foundation models and tree‑based algorithms, demonstrating that enriched demographic embeddings can enhance classification tasks while remaining fully compatible with standard classifiers.
arXiv:2606. 12006v1 Announce Type: cross Abstract: Predicting time-to-event outcomes such as mortality is a fundamental task in clinical decision-making, commonly addressed through survival analysis.
The paper introduces Scaling Electronic Health Record Foundation Models for Population Health Management, a large‑scale model trained on billions of medical events from over 5 million patients in Taiwan and the United States. By aligning ICD codes across different health systems, the model achieves strong scaling and generalization across 11 chronic disease prediction tasks, outperforming tree‑based, general, and biomedical language models with high sensitivity at 99% specificity. It also demonstrates superior few‑shot performance on the EHRShot benchmark and shows that cross‑system alignment provides a stronger pretraining signal than single‑site duplication in data‑limited scenarios.
arXiv:2607. 19524v1 Announce Type: cross Abstract: Federated learning (FL) offers a promising approach to privacy-preserving clinical risk prediction, but its deployment remains limited by restricted data sharing, client heterogeneity, class imbalance, and the lack of realistic tabular electronic health record (EHR) benchmarks.
arXiv:2509. 10517v3 Announce Type: replace Abstract: Machine learning can predict in-hospital mortality, but data privacy and the statistical heterogeneity of clinical data hamper its use.
arXiv:2608.29419v1 Announce Type: cross Abstract: Deep learning architectures are increasingly proposed for patient trajectory modeling in electronic health records (EHRs), yet their advantage over s...
The paper evaluates TabPFN, a tabular foundation model, for motor insurance pricing by comparing it to generalized linear models (GLMs) and XGBoost on two motor third‑party liability datasets. Results show that TabPFN does not consistently outperform GLMs: it lags on claim frequency, especially when the in‑context training set is small, but performs competitively on claim severity where data are limited. Additionally, TabPFN’s inference times are substantially longer than those of the baseline methods.