arXiv AI

Weakly Supervised Segmentation as Semantic-Based Regularization

arXiv:2605. 13674v2 Announce Type: replace-cross Abstract: Weakly supervised semantic segmentation (WSSS) trains dense pixel-level segmentation models from partial or coarse annotations such as bounding boxes, scribbles, or image-level tags.

arXiv Machine Learning
Aug 12

FARCLUSS: Fuzzy Adaptive Rebalancing and Contrastive Uncertainty Learning for Semi-Supervised Semantic Segmentation

arXiv:2506. 11142v3 Announce Type: replace-cross Abstract: Semi-supervised semantic segmentation (SSSS) faces persistent challenges in effectively leveraging unlabeled data, such as ineffective utilization of pseudo-labels, exacerbation of class imbalance biases, and neglect of prediction uncertainty.

By Ebenezer Tarubinga, Jenifer Kalafatovich, Seong-Whan Lee
arXiv AI
Sep 2

Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting

The paper introduces a cross‑modal pseudo‑labeling pipeline for unsupervised domain adaptation in semantic segmentation, particularly for waste sorting. It combines SAM for class‑agnostic region proposals with EVA‑CLIP to assign semantic labels via region‑text similarity, applying confidence filtering to ensure reliable pseudo‑labels for self‑training. An optional BLIP‑based language‑grounded verification further refines ambiguous regions, and the method shows consistent improvements over source‑only baselines on synthetic‑to‑real driving and lab‑to‑factory waste sorting shifts.

By Udo Schlegel, Shubhangi, Gabriel Dax, Sai Rahul Kaminwar, Florian Karl, Thomas Seidl
arXiv AI
Aug 20

A Critical Synthesis of Uncertainty Quantification and Foundation Models for Semantic Segmentation

The paper presents the first systematic evaluation of uncertainty quantification (UQ) methods applied to a foundation model for semantic segmentation. By fine‑tuning a lightweight DPT decoder on the pretrained SAM2 encoder, the authors benchmark four UQ approaches—Monte Carlo Dropout, Deep Sub‑Ensemble, Test‑Time Augmentation, and Evidential Deep Learning—across Cityscapes, NYUv2, and two out‑of‑domain settings, comparing segmentation accuracy, calibration, uncertainty quality, and inference time. The results reveal clear trade‑offs between predictive performance, reliability, and computational cost, underscoring both the promise and current limitations of uncertainty‑aware foundation models for real‑world deployment.

By Steven Landgraf, Joceline Hinz, Markus Ulrich
Hugging Face Trending Papers
Jul 8

SHTA: Semantic Hard Token Correction and Center Alignment for Semi-Supervised Medical Image Segmentation

Recent advances in semi-supervised medical image segmentation have achieved remarkable performance through prediction consistency, pseudo-label supervision, and hard-region supervision. However, these methods primarily improve supervision quality rather than explicitly enforcing semantic consistency in the learned representations of hard regions.

arXiv Computer Vision
Sep 11

SSS: Semi-Supervised SAM-2 with Efficient Prompting for Medical Imaging Segmentation

The paper introduces SSS, a semi‑supervised framework that builds on the Vision Foundation Model SAM‑2 to improve medical image segmentation. It combines a weak‑to‑strong consistency regularization with a Discriminative Feature Enhancement mechanism and a prompt generator that uses Physical Constraints with a Sliding Window to supply prompts for unlabeled data. Experiments on the ACDC and BHSD datasets show that SSS outperforms prior methods, achieving a 53.15 Dice score on BHSD, a +3.65 improvement over the state of the art.

By Hongjie Zhu, Xiwei Liu, Rundong Xue, Zeyu Zhang, Yong Xu, Daji Ergu, Ying Cai, Yang Zhao
Hugging Face Trending Papers
Aug 19

A Critical Synthesis of Uncertainty Quantification and Foundation Models for Semantic Segmentation

The paper presents the first systematic evaluation of uncertainty quantification (UQ) methods applied to a foundation model for semantic segmentation. By fine‑tuning a lightweight DPT decoder on the pretrained SAM2 encoder, the authors benchmark four UQ approaches—Monte Carlo Dropout, Deep Sub‑Ensemble, Test‑Time Augmentation, and Evidential Deep Learning—across Cityscapes, NYUv2, and two out‑of‑domain settings. The study compares segmentation accuracy, calibration, uncertainty quality, and inference time, revealing trade‑offs between predictive performance, reliability, and computational cost.