arXiv:2605. 10840v3 Announce Type: replace-cross Abstract: We present Clin-JEPA, a multi-phase co-training framework for joint-embedding predictive (JEPA) pretraining on EHR patient trajectories.
arXiv:2607. 16681v1 Announce Type: new Abstract: Early sepsis prediction from electronic health records is challenged by irregular sampling, high missingness, and class imbalance.
arXiv:2607. 26752v1 Announce Type: new Abstract: Medical world models aim to learn a latent state of patient or organ physiology and a transition function that forecasts how that state evolves under interventions, supporting downstream tasks from imaging-based diagnosis to digital-twin treatment planning.
arXiv:2608. 20065v1 Announce Type: new Abstract: World models construct latent states that support prediction, planning, and reasoning about an underlying system.
arXiv:2603. 19100v2 Announce Type: replace Abstract: Electroencephalography (EEG) enables non-invasive monitoring of brain activity across clinical and neurotechnology applications, yet building foundation models for EEG remains challenging due to differing electrode topologies and computational scalability, as Transformer architectures incur quadratic sequence complexity.
The paper introduces a bounded updating framework for ICU prediction models that freezes the physiological encoder while allowing updates only to the treatment pathway and fusion head. Experiments on 84,792 MIMIC-IV ICU stays across four temporal shifts show that selective adaptation yields more stable explanations—higher rank correlation, better top‑5 feature agreement, and improved retrieval stability—compared to full model adaptation. Predictive performance varies by outcome, but the results demonstrate that explanation stability is governed by the structural boundaries of allowed adaptation rather than merely by freezing components.
arXiv:2608. 15483v1 Announce Type: new Abstract: Modern deep networks are trained through long update trajectories, yet their temporal organization remains less systematically characterized than architectures, losses, or optimizers.
arXiv:2607. 22264v1 Announce Type: new Abstract: Autoregressive foundation models trained on tokenized electronic health records (EHRs) can support zero-shot clinical prediction, yet most operate on structured event codes alone, and do not incorporate multiple modalities in a principled way.
arXiv:2609.25541v1 Announce Type: new Abstract: Tabular foundation models learn to predict cell values in context, whereas world-model self-supervision asks for prediction in representation space (Le...
JEPA-Anything is a domain‑agnostic framework that uses orthogonal predictive factorization (OPF) to decompose latent targets into complementary factors, learn them via dedicated pathways, and recombine them for shared prediction. The method is evaluated across seven diverse domains—vision, biology, clinical trajectories, control, molecular dynamics, physical fields, and weather—showing improvements on 10 dynamics tasks, reduced error on Interventional Pong, and lowest one‑step and 100‑step molecular errors among compared methods. Experimental validation includes a factor‑nominated biological intervention that succeeded in cell co‑cultures, organoids, tumor fragments, and mice, and latent orbital modes that recover the Keplerian scaling exponent.
Orthogonal JEPA introduces a latent world‑modeling framework that factorizes predictive states into orthogonal components. By learning basis matrices and dedicated prediction branches, the method reduces redundancy and improves gradient signals for less dominant predictive structures. The factorized states can be synthesized into complete latent representations for downstream tasks such as decoding, planning, or autoregressive rollout, and are evaluated across vision, biology, health, control, and molecular dynamics domains.
arXiv:2609.10464v1 Announce Type: cross Abstract: Joint-Embedding Predictive Architecture (JEPA) world models learn a compact latent representation of the world that supports prediction and planning,...
arXiv:2607. 00958v1 Announce Type: new Abstract: Time series are central to modern data mining applications, from industrial telemetry and server metrics to finance and physiology, yet time-series self-supervised learning often depends on view and augmentation choices that encode domain-specific invariances.