Hugging Face Blog

Fine-Tune a Semantic Segmentation Model with a Custom Dataset

arXiv Machine Learning
Jul 8

Conformal Prediction Sets for Instance Segmentation

arXiv:2602. 10045v2 Announce Type: replace-cross Abstract: Current instance segmentation models achieve high performance on average predictions, but lack principled uncertainty quantification: their outputs are not calibrated, and there is no guarantee that a predicted mask is close to the ground truth.

By Kerri Lu, Dan M. Kluger, Stephen Bates, Sherrie Wang
arXiv AI
3d ago

The Impact of CutMix on Reliability and Robustness in Semantic Segmentation

The paper investigates how the CutMix data augmentation technique affects reliability and robustness in semantic segmentation. It evaluates two architectures—CNN-based DeepLabV3+ and transformer-based SegFormer—on both in-domain and out-of-domain data. Results show that CutMix has a minor effect on segmentation accuracy but consistently improves reliability, especially under distribution shifts, by enhancing calibration and uncertainty quality.

By Steven Landgraf, Markus Ulrich
arXiv AI
3d ago

A Critical Synthesis of Uncertainty Quantification and Foundation Models for Semantic Segmentation

The paper presents the first systematic evaluation of uncertainty quantification (UQ) methods applied to a foundation model for semantic segmentation. By fine‑tuning a lightweight DPT decoder on the pretrained SAM2 encoder, the authors benchmark four UQ approaches—Monte Carlo Dropout, Deep Sub‑Ensemble, Test‑Time Augmentation, and Evidential Deep Learning—across Cityscapes, NYUv2, and two out‑of‑domain settings, comparing segmentation accuracy, calibration, uncertainty quality, and inference time. The results reveal clear trade‑offs between predictive performance, reliability, and computational cost, underscoring both the promise and current limitations of uncertainty‑aware foundation models for real‑world deployment.

By Steven Landgraf, Joceline Hinz, Markus Ulrich
Hugging Face Trending Papers
Jul 8

SHTA: Semantic Hard Token Correction and Center Alignment for Semi-Supervised Medical Image Segmentation

Recent advances in semi-supervised medical image segmentation have achieved remarkable performance through prediction consistency, pseudo-label supervision, and hard-region supervision. However, these methods primarily improve supervision quality rather than explicitly enforcing semantic consistency in the learned representations of hard regions.