arXiv Computer Vision

Automated 2D and 3D Segmentation of AMD and DME Lesions in OCT

This study presents four deep‑learning pipelines—two‑dimensional and three‑dimensional—for segmenting age‑related macular degeneration (AMD) and diabetic macular edema (DME) lesions in optical coherence tomography (OCT) images. The models achieve Dice scores between 0.76 and 0.82 and demonstrate strong volumetric and surface calibration (r_vol, r_surf ≥ 0.97) on an in‑domain validation set. Generalization was assessed on the OLIVES clinical cohort using proxy metrics such as biomarker AUROC, central subfield thickness correlation, and longitudinal concordance, showing that the predictions still track clinical biomarkers outside the training distribution, albeit with reduced strength.

arXiv Computation and Language
Sep 7

Retinal OCTA Phenotyping with LLM Reporting for Alzheimer's Disease

The study introduces an explainable OCTA pipeline for Alzheimer’s disease phenotyping that combines vessel segmentation, layer‑specific biomarker extraction, and label‑free phenotyping with large language model (LLM) reporting. Using 117 images from 39 subjects, the segmentation models achieved high ROC‑AUC (0.916–0.970) and Dice scores (0.695–0.781), and six vascular biomarkers were used to create subject‑level profiles for exploratory clustering. LLMs (GPT, Gemini, Llama) produced measurement‑grounded reports evaluated for citation faithfulness and diagnostic caution, offering a transparent, non‑diagnostic link between retinal vascular data and Alzheimer’s research.

By Progga Paromita Dutta, Jeba Maliha, Md Rafiul Kabir
arXiv Computer Vision
2d ago

A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models

The paper introduces RetinaGroundBench, a new benchmark for visual grounding of retinal OCT images, featuring 815 B-scans annotated with 4,537 bounding boxes for 13 biomarkers across 8 diseases. It evaluates 27 multimodal large language models (MLLMs) and finds that visual grounding is largely unsolved, with the best model achieving only a macro F1 of 23.7%. The authors also present RetGrounder, an 8‑B parameter MLLM fine‑tuned for OCT, which raises grounding F1 to 33.9%, a 43% relative improvement.

By Ronald Fecso, Jos\'e Morano, Botond Fazekas, Paul Widmann-Sedlnitzky, Dorota Himel, Laetita Hinterhuber, Virginia Mares, Andreas Pollreisz, Hrvoje Bogunovi\'c
arXiv Computer Vision
Sep 3

Evaluating Fundus-Specific Foundation Models for Diabetic Macular Edema Detection

The study evaluates fundus-specific foundation models (FM) for detecting diabetic macular edema (DME) in retinal images. It compares two popular FM—RETFound and FLAIR—against a lightweight EfficientNet-B0 backbone across multiple datasets (IDRiD, MESSIDOR-2, and OCT-and-Eye-FundusImages). Results indicate that FM do not consistently outperform fine‑tuned CNNs; EfficientNet-B0 often matches or exceeds FM performance, with FLAIR being the most competitive FM.

By Franco Javier Arellano, Jos\'e Ignacio Orlando
arXiv AI
Sep 1

Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration

Co-Annotator is a clinical AI system that distills expert gaze and dictation into two guidance components: a gaze‑aligned Vision Transformer that highlights fixation‑aligned areas of interest (AOIs) and an ontology‑bounded vision‑language model that pre‑fills editable biomarker summaries for retinal OCT. In controlled studies, each modality independently improved diagnostic accuracy and biomarker generation, and when combined across two academic institutions, the system increased correct diagnoses per minute by 40% and reduced comment editing time by 67% without compromising accuracy.

By Ziheng "Leo" Li, Benjamin Freeman, Akshay Raman, Kavin Aravindhan Rajkumar, Xinxin Fang, Rishabh Srivastava, Steven Feiner, Kaveri A. Thakoor
arXiv Computer Vision
Sep 14

An Ultra-Widefield Swept-Source OCTA Dataset and a Polar-Gated Mamba Network for Retinal Vessel Segmentation

arXiv:2609.12574v1 Announce Type: new Abstract: Ultra-widefield (UWF) swept-source optical coherence tomography angiography (SS-OCTA) enables large-area retinal vascular imaging, yet vessel segmentat...

By Yang Liu, Yibing Shen, Keming Zhao, Cenk Jiang, Zhenghang Qian, Zhicheng Du, Chen Xiong, Qidong Shao, Zijun Lin, Yunqi Hu, Jingjing Zhou, Lian Zhang, Peter E. Lobie, Peiwu Qin, Chengming Yang
arXiv AI
Aug 3

DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation

arXiv:2607. 29337v1 Announce Type: cross Abstract: Background and Objective: Generating realistic medical images with anatomically accurate segmentation masks helps address the shortage of annotated data in medical imaging, particularly in optical coherence tomography (OCT) of mouse eyes, where manual retinal layer delineation is labour-intensive due to tiny structures and required expertise, resulting in scarce datasets.

By Fernando Garc\'ia-Torres, Roc\'io del Amor, Sandra Morales, \'Alvaro Barroso, Peter Heiduschka, Bj\"orn Kemper, Valery Naranjo