arXiv Computer Vision
When Adaptation Hurts: Connecting Representational Drift to OOD Failures in MedSAM Fine-Tuning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Jul 13
TCLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models
arXiv:2607. 09562v1 Announce Type: cross Abstract: Medical Vision-Language Models (VLMs) exhibit strong zero-shot performance, yet their effectiveness still declines on out-of-distribution (OOD) data due to domain shifts and class bias inherited from large-scale pretraining.
arXiv AI
Jul 14
Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
arXiv:2607. 10358v1 Announce Type: cross Abstract: Foundation models are increasingly used as image feature extractors for mammography, but their robustness under external domain shift remains unclear.
arXiv AI
Jun 4
Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models
arXiv:2606. 04922v1 Announce Type: cross Abstract: Current prompt-based and adapter-based tuning of vision-language models (VLMs) is attractive for medical imaging, where clinical data sensitivity favors frozen backbones and annotations are limited.
arXiv AI
Aug 20
A Few Cases Are All You Need: An Empirical Study of Annotation-Efficient LoRA Fine-Tuning of MedSAM3
The study investigates how few expert-annotated cases are needed to fine‑tune MedSAM3 for abdominal organ segmentation using Low‑Rank Adaptation (LoRA). With only 10 annotated CT or MRI cases, the LoRA‑adapted models achieve performance comparable to specialist systems that require orders of magnitude more data, including reliable gallbladder segmentation and near‑state‑of‑the‑art results for liver, kidneys, and spleen. The approach also generalizes to cardiac segmentation on the Whole Heart dataset, and training takes only 3–5 hours per organ on a single GPU, roughly twice as fast as nnU-Net.
arXiv Computer Vision
4d ago
MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models
MVC-Bench is a new benchmark designed to evaluate the calibration of vision‑language models (VLMs) and medical VLMs (Medical‑VLMs) for medical image classification. It tests calibration across robustness to modality, backbone, and domain shift; effectiveness of calibration strategies and prompt‑tuning methods; and stability under prompt‑template and random‑seed variations. The benchmark includes eight backbones, three medical modalities (fundus imaging, histopathology, chest X‑ray), and compares post‑hoc, train‑time, and zero‑shot calibration approaches, reporting accuracy, Expected Calibration Error (ECE), Maximum Calibration Error (MCE), and Adaptive Calibration Error (ACE) over 1,638 experiments, while also proposing a Multi‑Class Margin (MCM) regularization technique that improves ECE in most settings.
arXiv Machine Learning
Jul 9
MedPMC: A Systematic Framework for Scaling High-Fidelity Medical Multimodal Data for Foundation Models
arXiv:2607. 07673v1 Announce Type: cross Abstract: Medicine is inherently multimodal, requiring clinicians to synthesize information across diverse data streams.