arXiv Computer Vision
MedVTok: A General-Purpose Medical Visual Tokenizer
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Jul 29
MedARC: Training-Free Adaptive Redundancy Compression of Visual Tokens for 3D Medical Vision-Language Models
Integrating 3D medical images with vision-language models (VLMs) holds substantial promise for computer-aided diagnosis. However, volumetric images generate prohibitively long visual-token sequences with considerable spatial and inter-slice redundancy.
arXiv Computer Vision
Oct 22
Expandable Modality Experts for Medical Vision-Language Learning
The paper introduces Expandable Modality Experts, a medical vision‑language framework that uses an expandable bank of modality experts and a Multiway Transformer to combine shared visual computation with deterministic routing and a separate text pathway. It employs a modality‑aware visual tokenizer for masked pretraining on 19.4 million unpaired image rows across seven modalities, followed by contrastive alignment on 3.23 million image‑text pairs. With a ViT‑Large backbone, the method achieves state‑of‑the‑art results in 24 of 25 benchmark settings across nine modalities, including zero‑shot classification, linear probing, and retrieval tasks, while preserving existing representations.
Hugging Face Trending Papers
Oct 21
Expandable Modality Experts for Medical Vision-Language Learning
Learning across medical imaging modalities requires making use of images without paired text and accommodating new domains while retaining existing representations. We propose a medical vision-languag...
arXiv AI
Jul 28
ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding
arXiv:2607. 24743v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) hold immense potential to revolutionize clinical practice, yet deploying them in the medical domain is fundamentally a vision-centric challenge: models must absorb knowledge from heterogeneous 2D and 3D medical images, and evaluation protocols must align with radiologists' clinical practice and provide an accurate, fine-grained and factualness-driven assessment.
Hugging Face Trending Papers
Jul 27
ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding
Multimodal large language models (MLLMs) hold immense potential to revolutionize clinical practice, yet deploying them in the medical domain is fundamentally a vision-centric challenge: models must absorb knowledge from heterogeneous 2D and 3D medical images, and evaluation protocols must align with radiologists' clinical practice and provide an accurate, fine-grained and factualness-driven assessment. In this paper, we introduce ClinFusion, a vision-centric MLLM designed for holistic medical understanding that systematically addresses these limitations.
arXiv AI
Jun 26
MedPruner: Training-Free Hierarchical Token Pruning for Efficient 3D Medical Image Understanding in Vision-Language Models
arXiv:2603. 11625v2 Announce Type: replace-cross Abstract: While specialized Medical Vision-Language Models (VLMs) have achieved remarkable success in interpreting 2D and 3D medical modalities, their deployment for 3D volumetric data remains constrained by significant computational inefficiencies.