arXiv Computer Vision

LEAF-Mamba: Feature Adaptation and Fusion for Whole Slide Image Analysis

LEAF-Mamba is a new framework for whole slide image analysis that jointly adapts and fuses frozen pretrained features. It uses a reconstruction‑regularized adapter to learn compact, task‑specific representations and combines parallel Mamba and convolutional streams to capture both long‑range dependencies and local interactions, with a gate that modulates their joint output before slide‑level pooling. Experiments show that this approach improves diagnostic classification and survival prediction over strong multiple‑instance learning baselines, and component analyses confirm the benefits of the adaptation and fusion modules.

arXiv Computer Vision
Oct 16

Beyond Sparse Captions: Aligning Slide-Level Text and Patch-Level Vision in Pathology

The paper introduces Locked Image Multiple Instance PreTraining (LIMIT), a method that aligns slide‑level pathology reports with patch‑level visual features by freezing a vision encoder and fine‑tuning a text encoder. LIMIT uses report embeddings as cross‑attention queries over bags of patch features, optimizing slide representations via InfoNCE. Applying LIMIT, the authors create CONCH‑Z, which achieves state‑of‑the‑art zero‑shot performance on 22 pathology tasks, outperforming vision‑language encoders trained on curated caption datasets and narrowing the gap with larger slide‑level foundation models.

By Daniel Shao, Dongmin Bang, Luca L. Weishaupt, Sophia J. Wagner, Nic G. Reitsam, Ming Y. Lu, Long P. Le, Richard J. Chen, Faisal Mahmood
arXiv Computer Vision
Aug 25

LanGuSTE: Language-Guided Coarse-to-Fine Patch Selection for Efficient Whole Slide Image Analysis

LanGuSTE is a patch‑selection framework for whole slide image analysis that uses vision‑language models and large language model knowledge. It introduces Cross‑Scale Visual Prompt Tuning to align low‑resolution and high‑resolution patches, and a coarse‑to‑fine selection module that encodes only informative high‑resolution patches. Experiments show LanGuSTE cuts overall processing time to about one‑third of the baseline while matching or surpassing diagnostic performance of exhaustive and state‑of‑the‑art methods.

By Yonghan Shin, Gangsu Kim, Won-Ki Jeong
arXiv AI
Oct 9

GPF-Net: Gated Progressive Fusion Learning for Polyp Re-Identification

The paper introduces GPF‑Net, a Gated Progressive Fusion Network designed for colonoscopic polyp re‑identification. It fuses multimodal features from multiple levels using fully connected gating mechanisms, allowing layer‑wise refinement of semantic information. Experiments on standard benchmarks show that this multimodal, progressive fusion approach outperforms state‑of‑the‑art unimodal ReID models, especially for small polyps where fine‑grained details are crucial.

By Suncheng Xiang, Xiaoyang Wang, Junjie Jiang, Hejia Wang, Dahong Qian