arXiv Computer Vision

Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce

arXiv AI
Sep 28

Combining General and Domain-Specific Pretext Tasks for Brain MR Image Segmentation

The paper investigates combining a domain‑specific self‑supervised task—voxel‑level brain age prediction—with a general task—image inpainting—to pretrain models for brain MRI segmentation. A multitask pretraining framework jointly optimizes both objectives, yielding representations that outperform single‑task pretraining and training from scratch on three segmentation benchmarks (multiple sclerosis lesions, ischemic stroke lesions, and cortical structures). The study demonstrates that integrating domain‑specific and general self‑supervised tasks benefits the development of generalizable neuroimaging foundation models.

By Tasneem Nasser, Susanne Schmid, Roberto Souza, Naser El-Sheimy
arXiv AI
Sep 21

Diagnostic-Guided Longitudinal Modeling for Forecasting Retinal Atrophy Progression

The study proposes a diagnostic-guided approach to choose between stochastic and deterministic longitudinal imaging models based on whether inter-visit changes are driven by disease progression or acquisition variability. Applied to a large, heterogeneous Optos fundus autofluorescence archive, the diagnostic revealed weak time-dependent changes and limited benefit from stochastic models, leading to the development of the deterministic Temporal Retinal U‑Net (TRU). TRU outperformed other classical and deep‑learning comparators on image‑level and eye‑specific progression metrics across held‑out and independent zero‑shot transfer cohorts, though with slightly lower precision in a smaller cross‑vendor cohort.

By Liyin Chen, Souvick Mukherjee, Ines Maria De Carvalho Lains, Nazlee Zebardast, Mengyu Wang, Tobias Elze, Jason I. Comander
arXiv Machine Learning
Oct 7

Stochastic Siamese MAE Pretraining for Longitudinal Medical Images

arXiv:2512.23441v2 Announce Type: replace Abstract: Temporally aware image representations are crucial for capturing disease progression in 3D volumes of longitudinal medical datasets. However, recen...

By Taha Emre, Arunava Chakravarty, Thomas Pinetz, Dmitrii Lachinov, Martin J. Menten, Hendrik Scholl, Sobha Sivaprasad, Daniel Rueckert, Andrew Lotery, Stefan Sacu, Ursula Schmidt-Erfurth, Hrvoje Bogunovi\'c
Hugging Face Trending Papers
Aug 27

Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification

The paper explores contrastive self‑supervised learning (SSL) for retinal fundus image classification, comparing SimSiam and SimCLR under limited data and computational resources. It investigates how retinal‑specific augmentation strategies and training parameters affect representation quality, evaluated through linear probing and fine‑tuning on multi‑disease classification and diabetic retinopathy grading tasks. The results demonstrate that tailored augmentations enable lightweight SSL models to learn transferable representations, reducing reliance on large annotated datasets while achieving competitive performance.

arXiv AI
Jul 23

Self-supervision drives representational convergence in medical foundation models more than clinical supervision

arXiv:2607. 20274v1 Announce Type: cross Abstract: Medical image encoders from different groups are increasingly treated as interchangeable, on the assumption that scale and clinical supervision concentrate their representations onto a shared structure.

By Soroosh Tayebi Arasteh, Sebastian Ziegelmayer, Mahshad Lotfinia, Lisa Adams, Sven Nebelung, Jakob Nikolas Kather, Daniel Truhn
arXiv Computer Vision
Oct 28

Systematic Morphometric Brain Autoencoding for Representation Learning in Neurodegenerative Diseases

The paper introduces SYMBA, a self‑supervised pretraining framework tailored for structural T1‑weighted brain MRI. SYMBA uses anatomically constrained masking, a multi‑scale structural similarity reconstruction loss, and a progressive curriculum to capture distributed morphometric patterns. Evaluated on nine heterogeneous cohorts and two unseen datasets, SYMBA outperforms existing neuroimaging foundation models, achieving high AUROC scores for Alzheimer’s disease classification, mild cognitive impairment conversion, and amyloid status prediction, and shows strong sample efficiency in low‑label settings.

By Nuria Balb\'as-Esteban, Albert Belenguer-Llorens, Elaheh Moradi, Jussi Tohka, Vanessa G\'omez-Verdejo, Carlos Sevilla-Salcedo
arXiv Machine Learning
Aug 28

Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification

The paper explores contrastive self‑supervised learning (SSL) for retinal fundus image classification, comparing SimSiam and SimCLR under limited data and computational resources. It investigates how retinal‑specific augmentation strategies and training parameters affect representation quality, evaluated through linear probing and fine‑tuning on multi‑disease classification and diabetic retinopathy grading tasks. Results indicate that tailored augmentations enable lightweight SSL models to learn transferable representations, reducing reliance on large annotated datasets while achieving competitive performance.

By Bekzat Nurlanbekova, Fung Fung Ting