arXiv Computer Vision

Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce

arXiv AI
2d ago

Diagnostic-Guided Longitudinal Modeling for Forecasting Retinal Atrophy Progression

The study proposes a diagnostic-guided approach to choose between stochastic and deterministic longitudinal imaging models based on whether inter-visit changes are driven by disease progression or acquisition variability. Applied to a large, heterogeneous Optos fundus autofluorescence archive, the diagnostic revealed weak time-dependent changes and limited benefit from stochastic models, leading to the development of the deterministic Temporal Retinal U‑Net (TRU). TRU outperformed other classical and deep‑learning comparators on image‑level and eye‑specific progression metrics across held‑out and independent zero‑shot transfer cohorts, though with slightly lower precision in a smaller cross‑vendor cohort.

By Liyin Chen, Souvick Mukherjee, Ines Maria De Carvalho Lains, Nazlee Zebardast, Mengyu Wang, Tobias Elze, Jason I. Comander
Hugging Face Trending Papers
Aug 27

Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification

The paper explores contrastive self‑supervised learning (SSL) for retinal fundus image classification, comparing SimSiam and SimCLR under limited data and computational resources. It investigates how retinal‑specific augmentation strategies and training parameters affect representation quality, evaluated through linear probing and fine‑tuning on multi‑disease classification and diabetic retinopathy grading tasks. The results demonstrate that tailored augmentations enable lightweight SSL models to learn transferable representations, reducing reliance on large annotated datasets while achieving competitive performance.

arXiv AI
Jul 23

Self-supervision drives representational convergence in medical foundation models more than clinical supervision

arXiv:2607. 20274v1 Announce Type: cross Abstract: Medical image encoders from different groups are increasingly treated as interchangeable, on the assumption that scale and clinical supervision concentrate their representations onto a shared structure.

By Soroosh Tayebi Arasteh, Sebastian Ziegelmayer, Mahshad Lotfinia, Lisa Adams, Sven Nebelung, Jakob Nikolas Kather, Daniel Truhn
arXiv Machine Learning
Aug 28

Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification

The paper explores contrastive self‑supervised learning (SSL) for retinal fundus image classification, comparing SimSiam and SimCLR under limited data and computational resources. It investigates how retinal‑specific augmentation strategies and training parameters affect representation quality, evaluated through linear probing and fine‑tuning on multi‑disease classification and diabetic retinopathy grading tasks. Results indicate that tailored augmentations enable lightweight SSL models to learn transferable representations, reducing reliance on large annotated datasets while achieving competitive performance.

By Bekzat Nurlanbekova, Fung Fung Ting
arXiv AI
Sep 1

Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration

Co-Annotator is a clinical AI system that distills expert gaze and dictation into two guidance components: a gaze‑aligned Vision Transformer that highlights fixation‑aligned areas of interest (AOIs) and an ontology‑bounded vision‑language model that pre‑fills editable biomarker summaries for retinal OCT. In controlled studies, each modality independently improved diagnostic accuracy and biomarker generation, and when combined across two academic institutions, the system increased correct diagnoses per minute by 40% and reduced comment editing time by 67% without compromising accuracy.

By Ziheng "Leo" Li, Benjamin Freeman, Akshay Raman, Kavin Aravindhan Rajkumar, Xinxin Fang, Rishabh Srivastava, Steven Feiner, Kaveri A. Thakoor
arXiv AI
Jun 12

BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learning

arXiv:2604. 27277v3 Announce Type: replace-cross Abstract: Brain MRI underpins a wide range of neuroscientific and clinical applications, yet most learning-based methods remain task-specific and require substantial labeled data.

By Yizhou Wu, Shansong Wang, Yuheng Li, Mojtaba Safari, Mingzhe Hu, Chih-Wei Chang, Harini Veeraraghavan, Xiaofeng Yang
arXiv Computer Vision
Sep 15

Reverse Spatio-Temporal Disease Progression Modelling

The paper introduces a reverse spatio‑temporal disease progression model that reconstructs unobserved healthier anatomy from later diseased scans. It employs a two‑stage architecture: a frozen 3D vector‑quantised autoencoder creates a discrete latent space, and a Neural ODE learns continuous‑time dynamics, with a recurrent encoder initializing the latent state from reverse‑ordered observations. Experiments on a synthetic Morpho‑MNIST benchmark and longitudinal Alzheimer’s MRIs show the model can recover unseen prior states and outperform baseline methods in predicting healthy trajectories.

By Ulugbek Shernazarov, Moucheng Xu, Inomjon Ramatov