arXiv Computer Vision

What Remains OOD? OODConceptBench for Open-World Concept Recognition in Vision-Language Models

arXiv AI
Aug 18

OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models

arXiv:2602. 18094v2 Announce Type: replace-cross Abstract: Existing Visual-Language Models (VLMs) have achieved significant progress by being trained on massive-scale datasets, typically under the assumption that data are independent and identically distributed (IID).

By Ling Lin, Yang Bai, Heng Su, Congcong Zhu, Yaoxing Wang, Yang Zhou, Huazhu Fu, Jingrun Chen
arXiv Computer Vision
Oct 26

SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction

SetCon reformulates open-ended referring segmentation as set-level concept prediction, using LVLM-generated natural-language concepts instead of segmentation-specific tokens. It employs a hierarchical semantic decomposition that first predicts a shared set-level concept and then refines it into fine-grained concept groups aligned with target subsets. The method, supported by a two-stage annotation pipeline adding hierarchical semantic supervision, achieves state-of-the-art results on multiple image and video benchmarks, with performance gains increasing as the number of referred targets grows.

By Zhixiong Zhang, Yizhuo Li, Shuangrui Ding, Yuhang Zang, Shengyuan Ding, Long Xing, Yibin Wang, Qiaosheng Zhang, Jiaqi Wang
arXiv Computation and Language
Sep 10

Vague2Detect: Handling Ambiguous Prompts in Knowledge-Based Open-World Detection

Vague2Detect is a hybrid pipeline that improves object detection for ambiguous prompts by combining a fine‑tuned Sentence‑BERT to retrieve candidates from a structured household knowledge base, YOLO‑World to verify their presence in images, and a GPT‑3.5‑turbo fallback to generate new candidate descriptions when prompts fall outside the knowledge base. On a benchmark of household scenes, Vague2Detect raises the vague prompt success rate from 32% (YOLO‑World alone) to 61% with high precision, and up to 85% when the GPT fallback is used.

By Ibrohimjon Muminov (Dongguk University, Seoul, South Korea), Jihie Kim (Dongguk University, Seoul, South Korea)
arXiv Computer Vision
Oct 21

FocusOVD: Geometric and Contextual Feature Refinement for Open-Vocabulary Small-Object Detection

FocusOVD is an open‑vocabulary object detector that improves small‑object detection by refining geometric and contextual features without altering the frozen vision‑language model backbone. It introduces a Reweighted Cross‑scale Feature Fusion module to balance shallow and deep features, a Residual Pinwheel‑shaped Gated Convolution module to enhance local geometry in high‑resolution features, and a Residual Convolutional Gated Linear Unit module to suppress background activations and boost region‑of‑interest discriminability. Experiments on COCO‑OVD and LVIS‑OVD show that FocusOVD outperforms state‑of‑the‑art methods, achieving a novel‑category AP of 36.3% on COCO‑OVD and an overall AP of 33.7% on LVIS‑OVD.

By Hanlin Kou, Beiqi Bai, Li Chen, Youjia Jing, Shupan Li, Mingyuan Jiu