arXiv Computer Vision By Jiaye Yang, Yao Liu, Die Dai, Hanwen Zhang, Peiyuan Jiang, Qiao Liu, Yutong Xie, Peng Wang

Task-Performance Routing for Multi-Teacher Distillation in CT Medical Image Segmentation

Read the original on arXiv Computer Vision →

Task-Performance Routing (TPR) is a method for multi-teacher knowledge distillation in CT organ segmentation that assigns teacher weights based on region-wise segmentation errors, favoring teachers with lower errors in hard regions and using uniform weights in easy regions. It employs a hierarchical spatial partition to provide fine-grained routing in shallow encoder stages and coarse-grained routing in deeper stages. Experiments on BTCV, MSD-Liver, and MSD-Pancreas datasets demonstrate that TPR outperforms individual teachers, adaptive ensembles, and other multi-teacher distillation baselines, achieving Dice scores of 65.40% with SwinUNETR and 68.25% with U-Net on MSD-Pancreas.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning
Jun 2

Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models

arXiv:2606. 00928v1 Announce Type: cross Abstract: Multiplexed fluorescence microscopy improves tissue segmentation by providing complementary channels including nuclear (DAPI) and membrane (E-cadherin), that together encode richer spatial context than single-channel imaging alone.

By Sakib Mohammad, Jarin Ritu, Md Sakhawat Hossain
arXiv Machine Learning
Aug 27

Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Models

The paper introduces an unsupervised approach to medical image segmentation by training a Denoising Diffusion Probabilistic Model (DDPM) on 21 unlabeled abdominal CT scans to learn anatomical features. The encoder weights from the DDPM are transferred to a U‑Net for downstream segmentation on the BTCV multi‑organ dataset, resulting in a significant Dice score improvement for liver segmentation from 0.75 to 0.93. In low‑data regimes, diffusion‑pretrained models retain robust performance, achieving high Dice scores even with only 10% of labeled data.

By Akshat G, Divyansh Gupta, Shaleen Bhatnagar, Shilpa Ankalaki, Tusar Kanti Mishra
arXiv Computer Vision
Oct 12

Scaling Multi-Teacher Distillation for Digital Pathology

The paper introduces a scalable multi-teacher distillation (MTD) framework for digital pathology, addressing the poor performance of standard MTD when many teachers are used. By learning teacher‑specific representations through techniques such as learnable teacher tokens, a tailored attention scheme, mixture‑of‑experts layers, and a contrastive loss, the method scales effectively, enabling compact student encoders that are up to 10× more efficient than larger teacher models while matching or surpassing their performance on 39 tile‑ and slide‑level tasks. The authors release a new collection of efficient foundation models, OMNI, trained from ten state‑of‑the‑art teachers and provide an analysis of the complementary teacher‑specific representations.

By Sofi\`ene Boutaj, Pierre Marza, Varun Belagali, Dimitris Samaras, Maria Vakalopoulou, Stergios Christodoulidis
arXiv Computer Vision
Sep 4

Improving Clinical Target Volume Segmentation Accuracy using Anatomical Priors and Active Learning for the AGITG TOPGEAR Clinical Trial

The study explores how adding anatomical priors and active learning can improve the accuracy of deep learning models for segmenting the Clinical Target Volume (CTV) in gastric cancer radiotherapy. Using 100 retrospective CT scans, an nnU‑Net model trained on 10 expert‑contoured cases was enhanced with voxel‑wise anatomical prior maps and iterative active learning over four rounds. The combined approach raised the mean Dice Similarity Coefficient from 0.84 to 0.87, demonstrating that both techniques individually and together improve segmentation performance and generalizability.

By Phillip Chlap, Mark Lee, Trevor Leong, Matthew Field, Jason Dowling, Hang Min, Julie Chu, Jennifer Tan, Phillip K. Tran, Tomas Kron, Annette Haworth, Martin A. Ebert, Shalini K. Vinod, Lois Holloway