UnSAMv2 is a self‑supervised extension of the Segment Anything Model that can segment objects at any granularity without human annotations. It discovers mask‑granularity pairs and introduces a granularity control embedding for continuous scale adjustment, requiring only 6K unlabeled images and 0.02% extra parameters. The model outperforms SAM/SAM‑2 across 11+ benchmarks, improving metrics such as 1‑IoU from 58.0 to 73.1 and achieving state‑of‑the‑art performance on language‑guided segmentation.
By Junwei Yu, Trevor Darrell, XuDong Wang
SetCon reformulates open-ended referring segmentation as set-level concept prediction, using LVLM-generated natural-language concepts instead of segmentation-specific tokens. It employs a hierarchical semantic decomposition that first predicts a shared set-level concept and then refines it into fine-grained concept groups aligned with target subsets. The method, supported by a two-stage annotation pipeline adding hierarchical semantic supervision, achieves state-of-the-art results on multiple image and video benchmarks, with performance gains increasing as the number of referred targets grows.
By Zhixiong Zhang, Yizhuo Li, Shuangrui Ding, Yuhang Zang, Shengyuan Ding, Long Xing, Yibin Wang, Qiaosheng Zhang, Jiaqi Wang
Personalized segmentation and personalized retrieval both aim to identify the same physical object across different images. While the former localizes the object within a target image, the latter retr...
arXiv:2608.29917v1 Announce Type: new
Abstract: Personalized segmentation and personalized retrieval both aim to identify the same physical object across different images. While the former localizes...
By Gabriele Trivigno, Marcos Alfaro, Claudia Cuttano, Gabriele Berton, Luis Pay\'a, Carlo Masone
arXiv:2610.20412v1 Announce Type: new
Abstract: To reach top accuracy, current fully supervised instance segmentation methods severely rely on large-scale pixel-wise labeled datasets. They are usuall...
By Linwei Chen, Ying Fu, Shaodi You, Hongzhe Liu
FoRIS is a training‑free in‑context segmentation framework that refines foreground masks through a coarse‑to‑fine process. It operates in three stages—Foreground Purification, Localization, and Consolidation—to suppress background noise, pinpoint target regions, and reconstruct complete foreground structures. The method achieves state‑of‑the‑art performance, improving mIoU by 4.5 and 4.8 points in 1‑shot and 5‑shot settings respectively.
By Ming Hu, Jianfu Yin, Mingyu Dou, Miaomiao Zhang, Yao Wang, Cong Hu, Bingliang Hu, Quan Wang
Prompt-driven vision-language models (VLMs) hold immense promise for accelerating dense remote sensing (RS) annotation, but static models suffer from severe performance degradation when deployed on novel scenes, unseen categories, or visually confusing backgrounds. Moreover, existing unified paradigms primarily rely on intra-image specific prompts, lacking flexible task routing to adapt to multi-intent operational workflows.
PANORAMA introduces a new panoptic grounded captioning framework that jointly generates detailed image captions and associates each phrase with precise pixel-level masks. The authors create PanoCaps, a human‑annotated benchmark with dense captions and near‑complete pixel coverage, and propose a phrase‑mask matching protocol with a generalized Panoptic Quality metric. PANORAMA conditions a pretrained segmenter on contextualized phrase representations, learns to select appropriate masks, and achieves state‑of‑the‑art grounding performance on PanoCaps and other pixel‑level tasks.
By Sara Pieri, Evangelos Kazakos, Shizhe Chen, Josef Sivic, Cordelia Schmid
Video panoptic segmentation (VPS) aims to jointly detect, segment, and track all objects while partitioning the video into semantically consistent regions. We introduce the task setting of unsupervised VPS, omitting any human supervision.
arXiv:2610.15669v2 Announce Type: replace-cross
Abstract: Weak bag-level labels are widely available in computational pathology, whereas reliable instance-level annotations for whole-slide images rem...
By Chen Shu, Chengyang Zhang, Boyu Fu, Ting Yin, Wenchuan Zhang, Jie Chen, Yuhao Yi, Hong Bu
arXiv:2610.29409v1 Announce Type: new
Abstract: Promptable segmentation models such as SAM 3 achieve remarkable open-vocabulary performance but require dedicated architectures, large-scale annotation...
By Abdullah Hamdi
The paper demonstrates that object detection benchmarks suffer from incomplete annotations, with re-annotation of COCO, Pascal VOC, Cityscapes, and KITTI revealing up to a 60% increase in detected objects, especially small, occluded, or densely packed instances. The authors propose a scalable annotation pipeline that uses multiple annotators per object to capture uncertainty and improve recall, and they introduce two new large-scale benchmarks: an uncertainty-aware detection benchmark and a label error detection benchmark based on real errors. Their findings show that benchmark performance is highly sensitive to annotation quality, yet model rankings remain largely unchanged, highlighting the need for uncertainty-aware evaluation to better reflect real-world ambiguity.
By Sarina Penquitt, Jonathan Klees, Antonia van Betteray, Parssa Jashnieh, Peter Stehr, Matthias Rottmann, Lars Schmarje