Meta-CLIP is a metadata‑conditioned contrastive learning framework that incorporates DICOM acquisition information to reweight cross‑modal negatives during medical vision‑language pretraining. By defining a bounded pairwise margin over numerical and categorical DICOM fields, the method emphasizes distinctions among studies with similar imaging conditions while keeping the kernel fixed during optimization. Evaluations on chest radiography and volumetric CT show that Meta‑CLIP improves zero‑shot classification performance, achieving higher macro‑AUROC scores than baseline CLIP models on multiple benchmarks.
arXiv:2601.15891v4 Announce Type: replace Abstract: Vision-language pretraining has driven progress in medical image representation learning, but it depends on paired image-text data and can inherit...
arXiv:2609.39266v1 Announce Type: new Abstract: Fine-grained vision-language alignment in chest radiography enables zero-shot classification, grounding, and segmentation without task-specific annotat...
Med-AR introduces two autoregressive vision‑language models, Med‑AR‑8B and Med‑AR‑2B, pretrained on structured radiology reports, abnormality‑focused text, and region annotations to address long‑tailed chest X‑ray classification. The models outperform existing contrastive, self‑supervised, and supervised encoders—including Med‑CLIP, CheXFound, EVA‑Base, ARK, and BioViL‑T—across PadChest, MIMIC‑CXR, and CheXpert, achieving higher mean AUROC and AUPRC for head, medium, and tail findings and lower excess area under the risk‑coverage curve. Med‑AR also demonstrates improved selective‑prediction performance, with Med‑AR‑8B raising tail‑label mean AUPRC on MIMIC‑CXR from 0.1033 to 0.1441 and Med‑AR‑2B delivering the strongest discrimination on PadChest.
arXiv:2608.24281v1 Announce Type: new Abstract: Reducing annotation requirements remains a key challenge in developing robust medical object detectors. To address this, Vision-Language (VL) object de...
The paper introduces SCCL-DT, a method that improves zero‑shot chest X‑ray diagnosis by addressing semantic conflicts in contrastive vision‑language pre‑training. It uses adaptive thresholds derived from exponential‑moving‑average statistics to hard‑mask conflicting pairs, and combines two teachers—an inclusive and a consensus rule—through distillation into a single student model. On five public chest X‑ray benchmarks, SCCL‑DT achieves a mean zero‑shot AUC of 0.850, outperforming the best baseline at 0.837.
arXiv:2510. 15042v3 Announce Type: replace-cross Abstract: In the 3D medical image domain, vision-language pre-training is used to create vision-language encoders (VLEs) that can support radiologists by retrieving patients with similar abnormalities, predicting likelihoods of abnormality, or, with downstream adaptation, generating radiological reports.
Vision-language pre-training (VLP) holds great promise for general-purpose medical AI by leveraging radiology reports as rich textual supervision, yet existing methods struggle with 3D CT imaging due to inefficient visual backbones and coarse semantic alignment. To address these issues, we propose a tailored VLP framework featuring three key components: (1) a CNN-ViT hybrid encoder that replaces ViT's patch embedding with a 3D CNN backbone to efficiently capture local anatomical details while preserving global attention and compatibility with pre-trained cross-modal priors; (2) a disease-level contrastive learning mechanism using learnable query tokens to dynamically extract disease-specific semantics from full reports and align them with corresponding visual features, thereby disentangling distinct diseases within the same anatomical region; and (3) a diagnosis-aware prompt strategy that employs real clinical phrases and aggregated disease prototypes to bridge the pre-training-inference gap and enhance zero-shot diagnostic reliability.
The paper introduces Expandable Modality Experts, a medical vision‑language framework that uses an expandable bank of modality experts and a Multiway Transformer to combine shared visual computation with deterministic routing and a separate text pathway. It employs a modality‑aware visual tokenizer for masked pretraining on 19.4 million unpaired image rows across seven modalities, followed by contrastive alignment on 3.23 million image‑text pairs. With a ViT‑Large backbone, the method achieves state‑of‑the‑art results in 24 of 25 benchmark settings across nine modalities, including zero‑shot classification, linear probing, and retrieval tasks, while preserving existing representations.
arXiv:2409.16183v2 Announce Type: replace Abstract: Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in m...
Learning across medical imaging modalities requires making use of images without paired text and accommodating new domains while retaining existing representations. We propose a medical vision-languag...
arXiv:2606. 03180v1 Announce Type: cross Abstract: Vision-language models (VLMs) for radiology have emerged as a scalable paradigm by leveraging image-report pairs naturally produced in clinical workflows.
arXiv:2608. 03890v1 Announce Type: cross Abstract: A clinically useful chest X-ray system must go beyond fluent report generation: it should classify findings with tunable decision thresholds, localize them spatially, and derive the anatomical measurements upon which many diagnoses depend.