arXiv AI By Junwei Yu, Trevor Darrell, XuDong Wang

UnSAMv2: Self-Supervised Learning Enables Segment Anything at Any Granularity

Read the original on arXiv AI →

UnSAMv2 is a self‑supervised extension of the Segment Anything Model that can segment objects at any granularity without human annotations. It discovers mask‑granularity pairs and introduces a granularity control embedding for continuous scale adjustment, requiring only 6K unlabeled images and 0.02% extra parameters. The model outperforms SAM/SAM‑2 across 11+ benchmarks, improving metrics such as 1‑IoU from 58.0 to 73.1 and achieving state‑of‑the‑art performance on language‑guided segmentation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Aug 4

UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution

Prompt-driven vision-language models (VLMs) hold immense promise for accelerating dense remote sensing (RS) annotation, but static models suffer from severe performance degradation when deployed on novel scenes, unseen categories, or visually confusing backgrounds. Moreover, existing unified paradigms primarily rely on intra-image specific prompts, lacking flexible task routing to adapt to multi-intent operational workflows.

arXiv Computer Vision
4d ago

Efficient SAM3 Adaptation for Multi-Class Semantic Segmentation via Dense Competitive Representations

The paper introduces DCR‑SAM, a framework that adapts the Segment Anything Model 3 (SAM3) for multi‑class semantic segmentation. By decoupling cross‑modal interactions, aligning textual concepts with visual representations, and adding a dense competition head and learnable background token, DCR‑SAM reduces inference latency, mitigates semantic misclassifications, and suppresses overlapping predictions. Experiments show 2.3%–10.7% performance gains, a 33× speedup over native SAM3, and strong robustness across benchmarks.

By Wenbin Liao, Hao Zhu, Yike Ma, Hao Jiang, Feng Dai
arXiv Computation and Language
Sep 17

PANORAMA: Panoptic Grounded Captioning via Mask Proposal Selection

PANORAMA introduces a new panoptic grounded captioning framework that jointly generates detailed image captions and associates each phrase with precise pixel-level masks. The authors create PanoCaps, a human‑annotated benchmark with dense captions and near‑complete pixel coverage, and propose a phrase‑mask matching protocol with a generalized Panoptic Quality metric. PANORAMA conditions a pretrained segmenter on contextualized phrase representations, learns to select appropriate masks, and achieves state‑of‑the‑art grounding performance on PanoCaps and other pixel‑level tasks.

By Sara Pieri, Evangelos Kazakos, Shizhe Chen, Josef Sivic, Cordelia Schmid