Hugging Face Blog

Universal Image Segmentation with Mask2Former and OneFormer

arXiv AI
Jul 2

LUMA: Benchmarking Segmentation via a Lightweight Universal Mask Adapter

arXiv:2607. 00687v1 Announce Type: cross Abstract: Comparing transformer backbones for image segmentation is confounded: each is paired with a different decoder, recipe, and pretraining, so reported differences rarely reflect the backbone itself.

By Tobias Christian Nauen, Anosh Billimoria, Federico Raue, Stanislav Frolov, Brian B. Moser, Andreas Dengel
arXiv Machine Learning
Jul 8

Conformal Prediction Sets for Instance Segmentation

arXiv:2602. 10045v2 Announce Type: replace-cross Abstract: Current instance segmentation models achieve high performance on average predictions, but lack principled uncertainty quantification: their outputs are not calibrated, and there is no guarantee that a predicted mask is close to the ground truth.

By Kerri Lu, Dan M. Kluger, Stephen Bates, Sherrie Wang
arXiv Computer Vision
Sep 25

Lightweight Vision Transformer-Based U-Net for Brain Tumor Segmentation from MRI

The paper introduces a lightweight Vision Transformer‑based U‑Net for brain tumor segmentation from MRI, combining U‑Net’s hierarchical feature extraction with a compact ViT bottleneck to capture both local and global context. With only 2.6 million trainable parameters, the model achieves a mean Intersection over Union of 0.8100 and a Dice score of 0.8446 on the TCGA LGG dataset, surpassing the baseline U‑Net by 3.75% and 3.15% respectively. Extensive quantitative and qualitative analyses, including confusion matrices, precision‑recall curves, and tumor size dependency studies, demonstrate the method’s effectiveness and robustness.

By Sheekar Banerjee, Md. Srabon Chowdhury, Md. Mahbub Hasan Akash, Ishtiak Al Mamoon