arXiv AI
Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Sep 1
Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
The rapid advancement of vision-language models (VLMs) has accelerated progress in computational pathology; however, whole-slide image (WSI)-based pathology report generation remains limited by the sc...
arXiv AI
Sep 10
Semantic Context-aware mOdality fUsion Transformer (SCOUT): A Context-Aware Multimodal Transformer for Concept-Grounded Pathology Report Generation
SCOUT is a concept‑grounded multimodal transformer that generates whole‑slide pathology reports by integrating local histological patterns, whole‑slide context, and expert‑curated diagnostic concepts. It uses evolving visual representations and recursively updated slide‑ and concept‑conditioned representations, with separate attention pathways during decoding that are fused adaptively for each token. Evaluated on TCGA‑BRCA, HistAI, and REG‑2025, SCOUT outperformed existing methods, improving BLEU, METEOR, and ROUGE‑L scores and raising the Clinical Report Quality Score on REG‑2025.
arXiv Computer Vision
Oct 9
PathLang: A Language-Centered Benchmark for Vision-Language Models in Computational Pathology
PathLang is a new, language‑centered benchmark for vision‑language models in computational pathology. It keeps the underlying pathology slides, ground‑truth labels, and image‑text evaluation direction constant while systematically varying the diagnostic language used in prompts, reflecting how pathologists actually rephrase diagnoses. The benchmark covers four task families—zero‑shot classification with image‑text alignment, cross‑modal retrieval, paraphrase robustness, and open‑vocabulary diagnosis retrieval—and evaluates nine VLMs across five public datasets spanning four organs.
arXiv Computer Vision
Aug 25
LanGuSTE: Language-Guided Coarse-to-Fine Patch Selection for Efficient Whole Slide Image Analysis
LanGuSTE is a patch‑selection framework for whole slide image analysis that uses vision‑language models and large language model knowledge. It introduces Cross‑Scale Visual Prompt Tuning to align low‑resolution and high‑resolution patches, and a coarse‑to‑fine selection module that encodes only informative high‑resolution patches. Experiments show LanGuSTE cuts overall processing time to about one‑third of the baseline while matching or surpassing diagnostic performance of exhaustive and state‑of‑the‑art methods.
arXiv Computer Vision
3d ago
Beyond Sparse Captions: Aligning Slide-Level Text and Patch-Level Vision in Pathology
The paper introduces Locked Image Multiple Instance PreTraining (LIMIT), a method that aligns slide‑level pathology reports with patch‑level visual features by freezing a vision encoder and fine‑tuning a text encoder. LIMIT uses report embeddings as cross‑attention queries over bags of patch features, optimizing slide representations via InfoNCE. Applying LIMIT, the authors create CONCH‑Z, which achieves state‑of‑the‑art zero‑shot performance on 22 pathology tasks, outperforming vision‑language encoders trained on curated caption datasets and narrowing the gap with larger slide‑level foundation models.
arXiv AI
Aug 18
From Generalist to Specialist: A Context-Fusion Framework for Endoscopic Polyp Reporting with a Frozen VLM
arXiv:2608. 15580v1 Announce Type: new Abstract: Reliable endoscopic polyp reporting requires integrating quantitative lesion sizing, standardized Paris classification, and clinically meaningful morphological description within a single record.