arXiv Machine Learning

Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images

The paper introduces Spatial‑FAD, a few‑shot medical anomaly detection framework that fuses Vision‑Language Model (CLIP) semantics with spatial priors from Vision Foundation Models (DINO). A VFM‑enhanced adapter injects structural affinity into CLIP features, while a sliding‑window aggregation produces high‑resolution embeddings for finer lesion localization. Prototype‑enhanced support memory further improves efficiency and performance, yielding significant gains on Liver CT, Retinal OCT, and Brain MRI datasets, notably an 11.4% Dice improvement in 4‑shot scenarios.

arXiv AI
Sep 4

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation

The paper introduces FreNet, a feature reconfiguration framework that incorporates visual priors for medical lesion segmentation. FreNet performs pixel‑level reconfiguration before encoding using an Implicit Prior Neural Network (IPNN) that leverages SAM, and feature‑level reconfiguration during encoding via a Dual‑domain Feature Reconfiguration (DFR) module, which includes a Frequency Decoupling Module (FDM) and a Spatial Localization Module (SLM). Experiments on nine benchmarks across three imaging modalities show that FreNet outperforms state‑of‑the‑art methods, achieving a 5.0% Dice improvement over the best baseline on the ETIS dataset and a 7.2% improvement over SAM.

By Yinan Liu, Jiankang Hong, Zhen Gao, Ye Lu
arXiv Computer Vision
Aug 24

Crane: Context-Guided Prompt Learning and Attention Refinement for Zero-Shot Anomaly Detection

Crane is a CLIP‑based framework for zero‑shot anomaly detection that enhances dense localization by adapting the vision encoder with a correlation‑based attention module and conditioning learnable prompts on global image context. It further fuses anomaly‑relevant patch features into the global representation for more sensitive image‑level detection, and a variant called Crane+ leverages DINOv2 spatial correlations for stronger pixel‑level performance. Across seven industrial benchmarks, Crane raises mean image‑level AP by 4.5% and Crane+ boosts mean pixel‑level AUPRO by 9.0%.

By Alireza Salehi, Mohammadreza Salehi, Reshad Hosseini, Cees G. M. Snoek, Makoto Yamada, Mohammad Sabokrou
Hugging Face Trending Papers
Sep 3

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation proposes FreNet, a framework that reconfigures images and features before and during encoding to improve lesion segmentation. It introduces an Implicit Prior Neural Network that uses a visual prior from SAM to suppress background responses, and a Dual-domain Feature Reconfiguration module that decouples features in frequency and spatial domains to better handle diverse lesion morphology. Experiments on nine benchmarks across three imaging modalities show FreNet outperforms state‑of‑the‑art methods, achieving a 5.0% Dice improvement over the best prior method on the ETIS dataset.

arXiv Machine Learning
Jun 3

GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations

arXiv:2606. 03180v1 Announce Type: cross Abstract: Vision-language models (VLMs) for radiology have emerged as a scalable paradigm by leveraging image-report pairs naturally produced in clinical workflows.

By Jonggwon Park, Seongeun Lee, Junhyun Park, Hannah Yun, Hyunwoong Kim, Sohyun Jeong, Hyewon Kang, Byungmu Yoon, Kyoyun Choi
arXiv Computer Vision
2d ago

BiCLIP: Bidirectional and Consistent Language-Image Processing for Robust Medical Image Segmentation

BiCLIP is a bidirectional multimodal framework that enhances medical image segmentation by allowing visual features to iteratively refine textual representations, improving semantic alignment. It incorporates an augmentation consistency objective to stabilize learning against perturbed inputs. Experiments on QaTa-COV19 and MosMedData+ show that BiCLIP outperforms state‑of‑the‑art image‑only and multimodal baselines, achieving strong performance even with only 1% labeled data and resisting common clinical artifacts such as motion blur and low‑dose CT noise.

By Saivan Talaei, Fatemeh Daneshfar, Abdulhady Abas Abdullah, Mourad Oussalah
arXiv Computer Vision
Aug 26

Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETR

arXiv:2608.24281v1 Announce Type: new Abstract: Reducing annotation requirements remains a key challenge in developing robust medical object detectors. To address this, Vision-Language (VL) object de...

By Sheethal Bhat, Bogdan Georgescu, Awais Mansoor, Mathias Zinnen, Pranjal Sahu, Florin C. Ghesu, Sasa Grbic, Andreas Maier