Similarity-as-Evidence: Calibrating Overconfident VLMs for Interpretable and Label-Efficient Medical Active Learning
Read the original on arXiv Computer Vision →The paper introduces Similarity-as-Evidence (SaE), a framework that calibrates overconfident Vision‑Language Models (VLMs) for medical active learning by reinterpreting text‑image similarity vectors as evidence and modeling them with a Dirichlet distribution. SaE’s Similarity Evidence Head (SEH) captures uncertainty through vacuity and dissonance, enabling a dual‑factor acquisition strategy that prioritizes high‑vacuity samples early and high‑dissonance samples later. Experiments on ten public medical imaging datasets demonstrate state‑of‑the‑art macro‑averaged accuracy (82.57%) and improved calibration (NLL = 0.425) under a 20% label budget.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.