← Back to all news
arXiv Machine Learning By Joshua Placidi, Yuxuan Liu, Jinpei Han, Marek Rei, A. Aldo Faisal

Pretraining EHR Foundation Models with Patient-Aware Sampling

Read the original on arXiv Machine Learning →

arXiv:2607. 22114v1 Announce Type: new Abstract: Autoregressive foundation models for electronic health records (EHRs) typically inherit pretraining methods from language modeling, where patient trajectories are concatenated into a single token stream and windows are sampled from that stream.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Jul 20

LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models

arXiv:2607. 15447v1 Announce Type: new Abstract: Recent research in clinical machine learning, focusing on outcome predictions in intensive care unit (ICU), has shifted from bespoke supervised models to foundation models, utilising modern representation learning methods.

By Jingteng Li, Alexander Capstick, Louise Rigny, Iona Biggart, Neil J Sebire, Payam Barnaghi
llmsragbenchmarks
More like this →
arXiv Machine Learning
Jun 8

One Loss to Rule Them All: Marked Time-to-Event for Structured EHR Foundation Models

arXiv:2602. 00541v2 Announce Type: replace Abstract: Clinical events captured in Electronic Health Records (EHR) are irregularly sampled and may consist of a mixture of discrete events and numerical measurements, such as laboratory values or treatment dosages.

By Zilin Jing, Vincent Jeanselme, Yuta Kobayashi, Simon A. Lee, Chao Pang, Aparajita Kashyap, Yanwei Li, Xinzhuo Jiang, Shalmali Joshi
More like this →
arXiv Machine Learning
Jul 27

Autoregressive EHR Foundation Models with Multimodal Inputs

arXiv:2607. 22264v1 Announce Type: new Abstract: Autoregressive foundation models trained on tokenized electronic health records (EHRs) can support zero-shot clinical prediction, yet most operate on structured event codes alone, and do not incorporate multiple modalities in a principled way.

By Yuxuan Liu, Joshua Placidi, Jinpei Han, Alfred John Balston, Marek Rei, A. Aldo Faisal
multimodalsafety
More like this →
arXiv AI
Sep 7

MedFlow: Class-Aware Multi-Scale Generation for Medical Time-Series Synthesis

MedFlow is a class‑aware multi‑scale flow matching framework designed to synthesize medical time‑series data. It uses a vector‑quantized multi‑scale tokenizer to capture both coarse and fine temporal patterns, and introduces Token Marginal Guidance to steer generation toward minority‑class characteristics. Experiments on four public datasets show MedFlow outperforms diffusion baselines, improving AUPRC by 5.8%, reducing Context‑FID by 88.6%, and achieving 3.8× higher sampling throughput.

By Yanhao Huang, Shibo Feng, Wanjin Feng, Peilin Zhao, Chunyan Miao
diffusionnlpefficiencybenchmarks
More like this →