Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2603. 18846v3 Announce Type: replace-cross Abstract: Foundation models are used to extract transferable representations from large amounts of unlabeled data, typically via self-supervised learning (SSL).
The study proposes a diagnostic-guided approach to choose between stochastic and deterministic longitudinal imaging models based on whether inter-visit changes are driven by disease progression or acquisition variability. Applied to a large, heterogeneous Optos fundus autofluorescence archive, the diagnostic revealed weak time-dependent changes and limited benefit from stochastic models, leading to the development of the deterministic Temporal Retinal U‑Net (TRU). TRU outperformed other classical and deep‑learning comparators on image‑level and eye‑specific progression metrics across held‑out and independent zero‑shot transfer cohorts, though with slightly lower precision in a smaller cross‑vendor cohort.
arXiv:2605. 23995v4 Announce Type: replace-cross Abstract: Self-supervised learning (SSL) is increasingly used in medical image analysis to reduce dependence on costly expert annotations by learning transferable representations from unlabeled data.
arXiv:2607. 16681v1 Announce Type: new Abstract: Early sepsis prediction from electronic health records is challenged by irregular sampling, high missingness, and class imbalance.
The paper explores contrastive self‑supervised learning (SSL) for retinal fundus image classification, comparing SimSiam and SimCLR under limited data and computational resources. It investigates how retinal‑specific augmentation strategies and training parameters affect representation quality, evaluated through linear probing and fine‑tuning on multi‑disease classification and diabetic retinopathy grading tasks. The results demonstrate that tailored augmentations enable lightweight SSL models to learn transferable representations, reducing reliance on large annotated datasets while achieving competitive performance.
arXiv:2607. 20274v1 Announce Type: cross Abstract: Medical image encoders from different groups are increasingly treated as interchangeable, on the assumption that scale and clinical supervision concentrate their representations onto a shared structure.