arXiv Computer Vision

Polyp-VSSD: A Pre-trained Transformer with Local-Global Joint VSSD Decoding for Polyp Segmentation

arXiv Computer Vision
Sep 11

SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data

SegCol is a new dataset and benchmark for semantic segmentation of colon fold edges and surgical instruments in colonoscopy images, derived from the EndoMapper dataset. It offers manually annotated pixel‑level masks for three instrument classes and thin fold‑edge structures across temporally consistent image sequences, and serves as the basis for the SegCol Challenge within the EndoVis Challenge at MICCAI 2024. The study evaluates supervised segmentation and annotation‑efficient active learning, analyzes various segmentation metrics under structural perturbations, and highlights how metric behavior depends on target structure, underscoring the need for carefully selected evaluation protocols in endoscopic segmentation.

By Xinwei Ju, Rema Daher, Razvan Caramalau, Baoru Huang, Danail Stoyanov, Francisco Vasconcelos
arXiv AI
Oct 1

Colorectal Cancer Segmentation with Adaptive Augmentation and Multi-Resolution Ensemble Models

The paper presents an automated segmentation pipeline for whole‑slide histopathology images of colorectal cancer, labeling tumor grades 1‑3 and normal mucosa. It employs dense prediction transformers with multiple encoder backbones, overlapping patches, test‑time augmentation, and an adaptive augmentation policy guided by large language models. The approach, combined with soft‑voting ensembles and post‑processing refinements, raises the F1 score from 62.92 to 69.84 on a colorectal cancer grade dataset.

By \"Umit Mert \c{C}a\u{g}lar, Alptekin Temizel
arXiv AI
Oct 9

GPF-Net: Gated Progressive Fusion Learning for Polyp Re-Identification

The paper introduces GPF‑Net, a Gated Progressive Fusion Network designed for colonoscopic polyp re‑identification. It fuses multimodal features from multiple levels using fully connected gating mechanisms, allowing layer‑wise refinement of semantic information. Experiments on standard benchmarks show that this multimodal, progressive fusion approach outperforms state‑of‑the‑art unimodal ReID models, especially for small polyps where fine‑grained details are crucial.

By Suncheng Xiang, Xiaoyang Wang, Junjie Jiang, Hejia Wang, Dahong Qian
arXiv AI
Aug 10

Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation

arXiv:2608. 07176v1 Announce Type: cross Abstract: Developing foundation generative models for endoscopy is limited by the gap between natural and clinical images and the computational cost of training large Diffusion Transformers.

By Francisco Caetano, Tim J. M. Jaspers, Haiko Middeljans, Martijn R. Jong, Rixta A. H. van Eijck van Heslinga, Floor Slooter, Albert J. de Groof, Jacques J. Bergman, Peter H. N. De With, Fons van der Sommen
arXiv AI
Aug 18

From Generalist to Specialist: A Context-Fusion Framework for Endoscopic Polyp Reporting with a Frozen VLM

arXiv:2608. 15580v1 Announce Type: new Abstract: Reliable endoscopic polyp reporting requires integrating quantitative lesion sizing, standardized Paris classification, and clinically meaningful morphological description within a single record.

By Ruijie Yang, Yan Zhu, Peiyao Fu, Siyuan Li, Te Luo, Zhihua Wang, Quanlin Li, Pinghong Zhou, Xian Yang, Shuo Wang
arXiv AI
Jun 17

Geometry-Consistent Endoscopic Representations for Image-Guided Navigation via Structured Foundation Model Adaptation

arXiv:2606. 17340v1 Announce Type: cross Abstract: Accurate vision-based navigation in monocular endoscopy is difficult due to limited depth cues, weak tissue texture, non-rigid deformation, and substantial appearance variation across domains, all of which complicate pose estimation, depth prediction, and image-to-anatomy alignment.

By Hongchao Shu, Roger D. Soberanis-Mukul, Hao Ding, Morgan Ringel, Mali Shen, Saif Iftekar Sayed, Hedyeh Rafii-Tari, Mathias Unberath
arXiv AI
Sep 4

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation

The paper introduces FreNet, a feature reconfiguration framework that incorporates visual priors for medical lesion segmentation. FreNet performs pixel‑level reconfiguration before encoding using an Implicit Prior Neural Network (IPNN) that leverages SAM, and feature‑level reconfiguration during encoding via a Dual‑domain Feature Reconfiguration (DFR) module, which includes a Frequency Decoupling Module (FDM) and a Spatial Localization Module (SLM). Experiments on nine benchmarks across three imaging modalities show that FreNet outperforms state‑of‑the‑art methods, achieving a 5.0% Dice improvement over the best baseline on the ETIS dataset and a 7.2% improvement over SAM.

By Yinan Liu, Jiankang Hong, Zhen Gao, Ye Lu