arXiv Computer Vision

Knowledge distillation across teacher architectures for compact diabetic retinopathy grading

The study evaluates offline response-based knowledge distillation for five-class diabetic retinopathy grading on the APTOS 2019 dataset. Five teacher architectures—ResNet‑50, MobileNetV3‑Large, and Swin Transformer‑Tiny—were distilled into a MobileNetV3‑Small student, exploring a grid of teacher, temperature, and hard‑label weight settings. The best configuration achieved a quadratic weighted kappa of 0.9093 (macro‑F1 0.6851) on a single seed, with an average kappa of 0.9024 across three seeds, while reducing parameters by 18.07× compared to the Swin‑T teacher.

arXiv Machine Learning
1d ago

CalibCause: A Quality-Gated, Interpretable and Calibrated Deep Learning Framework for Diabetic Retinopathy Grading

CalibCause is a quality‑gated, interpretable deep learning framework for diabetic retinopathy grading that integrates visual explanations, label‑free image‑quality conditioning, knowledge distillation, and calibrated confidence with deferral. Using 51,310 fundus images from multiple datasets, the distilled student model achieved a quadratic weighted kappa of 0.863 and accuracy of 0.865 on pooled testing, while maintaining comparable performance across held‑out environments. The framework also demonstrated improved calibration (expected calibration error 0.025–0.036) and higher accuracy (up to 0.923) when deferring the least confident 20% of images.

By Sohaib Sulman, Muhammad Atif Saeed, Akhtar Jamil, Alaa Ali Hameed, Roland Aydin
arXiv Machine Learning
Jun 2

Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models

arXiv:2606. 00928v1 Announce Type: cross Abstract: Multiplexed fluorescence microscopy improves tissue segmentation by providing complementary channels including nuclear (DAPI) and membrane (E-cadherin), that together encode richer spatial context than single-channel imaging alone.

By Sakib Mohammad, Jarin Ritu, Md Sakhawat Hossain
arXiv Machine Learning
Aug 31

Explainable Diabetic Retinopathy Classification Using Vision Foundation Models

The paper presents an explainable diabetic retinopathy classification framework that leverages vision foundation models—DINOv2, CLIP, and Vision Transformer—combined with various transfer learning techniques such as full fine‑tuning, linear probing, and Low‑Rank Adaptation (LoRA). Using the ODIR dataset for internal validation and the APTOS dataset for external testing, DINOv2‑LoRA achieved the best internal AUROC (0.758) while DINOv2 and ViT full fine‑tuning reached the highest external AUROC (0.920). Explainability was assessed with Grad‑CAM and HiResCAM against expert‑annotated lesion masks from IDRiD, using Dice, IoU, and Pointing Game metrics, confirming that model attention aligns with clinically relevant retinal lesions.

By Abhishek Verma, Anila Krishna, Abhishek Gajanan Bankar, Juan Miguel Lopez Alcaraz
arXiv Machine Learning
Jul 7

Uncertainty-Aware Last-Layer Adaptation of RETFound for Referable Diabetic Retinopathy Screening Under Dataset Shift

arXiv:2607. 02569v1 Announce Type: cross Abstract: This paper presents a safety-centered empirical evaluation of uncertainty-aware last-layer adaptation for referable diabetic retinopathy screening using RETFound, a self-supervised vision-transformer retinal foundation model used here as a frozen feature encoder, and the public APTOS 2019 and DDR diabetic retinopathy fundus image datasets.

By Karim Mardhani
arXiv Computer Vision
Oct 27

Promise and Limits of Cross-Architecture Knowledge Distillation for Lightweight Medical Vision Transformers (LiteMed-ViT)

arXiv:2610.33520v1 Announce Type: new Abstract: Running deep models for medical image analysis at the point of care is challenging with standard architectures: convolutional neural networks (CNNs) ar...

By Shuaibu Shehu (SR University), Elijah M. Flomo (SR University), Mohammad Safiya (GITAM University), Anurodh Kumar (SR University), Subodh Kumar (Dr. KNS Memorial Institute of Medical Sciences)
arXiv Computer Vision
Oct 22

From Canon to Nikon: Camera Domain Shift and Potential Equity Implications in Retinal AI

The study examines how the choice of camera—Canon versus Nikon—affects image quality and AI performance in retinal screening for diabetic retinopathy. In a Brazilian cohort of 8,524 patients, Nikon images were more than twice as likely to be of inadequate quality compared with Canon, despite being cheaper. Using a frozen pretrained retinal foundation model, the authors evaluated 12 disease classification tasks across different resolutions and classifiers, finding that camera-related performance differences vary widely and are not consistently mitigated by higher resolution or classifier choice.

By Lisa Y. W. Tang
arXiv AI
Oct 21

Gated Prototype Transfer for Zero-Support Medical Vision Language Model

The paper introduces Gated Knowledge‑Guided Prototype Transfer (GProtoT), a training‑free module that enhances zero‑support medical vision‑language models by transferring visual residuals from supported classes to missing ones using VLM similarity and clinical ontology distances. GProtoT employs an evidence gate to scale transfer based on semantic relevance, reducing negative transfer while modestly improving recall and accuracy in realistic one‑shot trials on MESSIDOR. The method requires no gradients, validation data, or extra inference, offering a low‑compute, accountable adaptation path for incomplete clinical supervision.

By Sumaiya Fazal, Rizwan Qureshi, Laleh Behjat, Samira Ebrahimi Kahou