arXiv Computer Vision By Wei Zhuo, Zhiyue Tang, Wufeng Xue, Hao Ding, Junkai Ji, Linlin Shen

UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelation

Read the original on arXiv Computer Vision →

The paper introduces UINO-FSS, a unified framework for few-shot semantic segmentation that merges knowledge from DINOv2 and SAM into a single-encoder architecture. It employs coarse-to-fine multimodal distillation, a bottleneck adapter for embedding alignment, a meta-visual prompt generator, and a mask decoder, enhanced by Mamba-based 4D correlation mining. Experiments on PASCAL-5i and COCO-20i demonstrate state‑of‑the‑art performance in 1‑shot settings, achieving 80.6% mIoU on PASCAL-5i and 64.5% on COCO-20i.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Oct 16

UniFGVC: Universal Training-Free Few-Shot Fine-Grained Vision Classification via Attribute-Aware Multimodal Retrieval

UniFGVC introduces a training‑free framework for few‑shot fine‑grained visual classification that reframes the task as a multimodal retrieval problem. It uses a Category‑Discriminative Visual Captioner to generate attribute‑aware textual descriptions, then matches image‑description pairs with category templates via pre‑trained encoders. Experiments on 12 datasets show that UniFGVC consistently outperforms existing CLIP‑based and fully‑supervised MLLM methods, demonstrating the effectiveness of the retrieval paradigm.

By Haiyun Guo, Hongyu Guo, Xiangzhao Hao, Jiarui Guo, Jinqiao Wang, Tat-Seng Chua
arXiv Computer Vision
Sep 25

Exploiting Target Knowledge from MLLMs for Robust Few-Shot Segmentation

The paper introduces MK‑FSS, a few‑shot segmentation framework that leverages Multimodal Large Language Models (MLLMs) to extract spatial and semantic target knowledge from query images. Spatial knowledge is encoded into a memory representation and fused with support‑guided memory via a dual‑memory debate‑fusion module, while semantic knowledge is turned into a textual feature and combined with multi‑scale query features through a progressive cross‑modal prompt generator. Together, these components produce a robust target representation that improves segmentation performance over existing methods.

By Yijun Hu, Heng Fan, Libo Zhang
Hugging Face Trending Papers
Jun 23

Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching

Cross-domain Few-shot Segmentation (CD-FSS) aims to transfer knowledge learned from source domain to distinct target domains, segmenting unseen target classes with only a few annotated samples. Although existing methods have made significant progress, they still rely on training or fine-tuning processes, which incur high computational costs and risk overfitting.

Hugging Face Trending Papers
Aug 4

SeCo-SBIR: Semantically Consistent Prompt Learning for Zero-Shot Sketch-Based Image Retrieval

Adapting CLIP for zero-shot sketch-based image retrieval (ZS-SBIR) via prompt learning faces a fundamental tension: the model must bridge the sketch-photo domain gap through task-specific adaptation, yet the added flexibility risks overfitting to seen training categories and eroding CLIP's zero-shot generalization. We present SeCo-SBIR, a semantically consistent prompt learning framework that resolves this tension from both sides.