arXiv AI

FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs

The paper introduces FOCUS, a cross‑dataset benchmark for retinal fundus models that evaluates vision‑only encoders, vision‑language dual encoders, and multimodal large language models across ten public datasets. It measures ranking performance, calibration, subgroup disparities, and image‑quality robustness for tasks such as diabetic retinopathy and glaucomatous optic neuropathy. Results show no single model family dominates, with vision‑only encoders ranking highest on average, while fine‑tuning improves in‑domain performance but varies in external transfer.

arXiv Computer Vision
Oct 23

A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models

The paper introduces RetinaGroundBench, a new benchmark for visual grounding of retinal OCT images, featuring 815 B-scans annotated with 4,537 bounding boxes for 13 biomarkers across 8 diseases. It evaluates 27 multimodal large language models (MLLMs) and finds that visual grounding is largely unsolved, with the best model achieving only a macro F1 of 23.7%. The authors also present RetGrounder, an 8‑B parameter MLLM fine‑tuned for OCT, which raises grounding F1 to 33.9%, a 43% relative improvement.

By Ronald Fecso, Jos\'e Morano, Botond Fazekas, Paul Widmann-Sedlnitzky, Dorota Himel, Laetita Hinterhuber, Virginia Mares, Andreas Pollreisz, Hrvoje Bogunovi\'c
arXiv AI
Aug 20

OptiModNet: A UNet-Transformer Hybrid with Grouped-Query and Channel Attention for Optic Disc and Cup Segmentation

OptiModNet is a lightweight UNet‑Transformer hybrid designed for optic disc and cup segmentation. It incorporates grouped‑query and channel attention across multiple stages, along with an Aggregated Pyramid Loss to improve gradient flow and structural consistency. Evaluated on the REFUGE2 dataset, it surpasses existing methods by over 2.5 % while using only 3.73 GFLOPs and 1.93 M parameters.

By Soumili Ghosh, Debapriya Roy, Aryan Das, Bikash Santra
arXiv Computer Vision
Sep 3

Evaluating Fundus-Specific Foundation Models for Diabetic Macular Edema Detection

The study evaluates fundus-specific foundation models (FM) for detecting diabetic macular edema (DME) in retinal images. It compares two popular FM—RETFound and FLAIR—against a lightweight EfficientNet-B0 backbone across multiple datasets (IDRiD, MESSIDOR-2, and OCT-and-Eye-FundusImages). Results indicate that FM do not consistently outperform fine‑tuned CNNs; EfficientNet-B0 often matches or exceeds FM performance, with FLAIR being the most competitive FM.

By Franco Javier Arellano, Jos\'e Ignacio Orlando
Hugging Face Trending Papers
Oct 22

A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models

The paper introduces RetinaGroundBench, a new benchmark for visual grounding of retinal OCT images, featuring 815 B-scans annotated with 4,537 bounding boxes for 13 biomarkers across 8 diseases. It evaluates 27 multimodal large language models (MLLMs) and finds that visual grounding remains largely unsolved, with the best model achieving only a 23.7% macro F1 score. To improve performance, the authors fine‑tune an 8B‑parameter MLLM, RetGrounder, using an OCT‑specific strategy that raises the grounding F1 to 33.9%, a 43% relative gain. whyItMatters":"The benchmark establishes a concrete reference for measuring progress in OCT diagnosis with multimodal large language models, highlighting the current limitations and guiding future improvements in visual grounding for clinical applications."

arXiv Computer Vision
Oct 22

From Canon to Nikon: Camera Domain Shift and Potential Equity Implications in Retinal AI

The study examines how the choice of camera—Canon versus Nikon—affects image quality and AI performance in retinal screening for diabetic retinopathy. In a Brazilian cohort of 8,524 patients, Nikon images were more than twice as likely to be of inadequate quality compared with Canon, despite being cheaper. Using a frozen pretrained retinal foundation model, the authors evaluated 12 disease classification tasks across different resolutions and classifiers, finding that camera-related performance differences vary widely and are not consistently mitigated by higher resolution or classifier choice.

By Lisa Y. W. Tang
arXiv Computer Vision
Aug 28

MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models

MVC-Bench is a new benchmark designed to evaluate the calibration of vision‑language models (VLMs) and medical VLMs (Medical‑VLMs) for medical image classification. It tests calibration across robustness to modality, backbone, and domain shift; effectiveness of calibration strategies and prompt‑tuning methods; and stability under prompt‑template and random‑seed variations. The benchmark includes eight backbones, three medical modalities (fundus imaging, histopathology, chest X‑ray), and compares post‑hoc, train‑time, and zero‑shot calibration approaches, reporting accuracy, Expected Calibration Error (ECE), Maximum Calibration Error (MCE), and Adaptive Calibration Error (ACE) over 1,638 experiments, while also proposing a Multi‑Class Margin (MCM) regularization technique that improves ECE in most settings.

By Ashshak Sharifdeen, Shihab Aaqil Ahamed, Ufaq Khan, Muhammad Akhtar Munir Sujair Ibrahim, Mohamed Rafeek Mareer Ahamed, Yutong Xie, Imran Razzak, Muhammad Haris Khan
arXiv Machine Learning
Aug 31

Explainable Diabetic Retinopathy Classification Using Vision Foundation Models

The paper presents an explainable diabetic retinopathy classification framework that leverages vision foundation models—DINOv2, CLIP, and Vision Transformer—combined with various transfer learning techniques such as full fine‑tuning, linear probing, and Low‑Rank Adaptation (LoRA). Using the ODIR dataset for internal validation and the APTOS dataset for external testing, DINOv2‑LoRA achieved the best internal AUROC (0.758) while DINOv2 and ViT full fine‑tuning reached the highest external AUROC (0.920). Explainability was assessed with Grad‑CAM and HiResCAM against expert‑annotated lesion masks from IDRiD, using Dice, IoU, and Pointing Game metrics, confirming that model attention aligns with clinically relevant retinal lesions.

By Abhishek Verma, Anila Krishna, Abhishek Gajanan Bankar, Juan Miguel Lopez Alcaraz
arXiv Machine Learning
Aug 28

Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification

The paper explores contrastive self‑supervised learning (SSL) for retinal fundus image classification, comparing SimSiam and SimCLR under limited data and computational resources. It investigates how retinal‑specific augmentation strategies and training parameters affect representation quality, evaluated through linear probing and fine‑tuning on multi‑disease classification and diabetic retinopathy grading tasks. Results indicate that tailored augmentations enable lightweight SSL models to learn transferable representations, reducing reliance on large annotated datasets while achieving competitive performance.

By Bekzat Nurlanbekova, Fung Fung Ting
arXiv Machine Learning
Jul 24

Counterfactual Explainability Framework With CycleGAN And Counterfactual-Classifier Alignnment Score for Retinal Disease Classification

arXiv:2607. 21068v1 Announce Type: new Abstract: Automated detection of vision impairing retina-based ocular conditions from fundus images is important for early screening, timely referral and reducing dependency on specialist-only assessment, for which neural network-based deep learning (DL) models have been widely utilized.

By Kritanu Chattopadhyay, Sayanjit Singha Roy, Soumya Chatterjee