arXiv AI

Generalized Decoupled Learning for Enhancing Open-Vocabulary Dense Perception

arXiv Computer Vision
Oct 21

FocusOVD: Geometric and Contextual Feature Refinement for Open-Vocabulary Small-Object Detection

FocusOVD is an open‑vocabulary object detector that improves small‑object detection by refining geometric and contextual features without altering the frozen vision‑language model backbone. It introduces a Reweighted Cross‑scale Feature Fusion module to balance shallow and deep features, a Residual Pinwheel‑shaped Gated Convolution module to enhance local geometry in high‑resolution features, and a Residual Convolutional Gated Linear Unit module to suppress background activations and boost region‑of‑interest discriminability. Experiments on COCO‑OVD and LVIS‑OVD show that FocusOVD outperforms state‑of‑the‑art methods, achieving a novel‑category AP of 36.3% on COCO‑OVD and an overall AP of 33.7% on LVIS‑OVD.

By Hanlin Kou, Beiqi Bai, Li Chen, Youjia Jing, Shupan Li, Mingyuan Jiu
arXiv AI
Sep 10

GoDeep: Annotation-Free Open-Vocabulary 3D Scene Understanding via Language-Space Lifting

GoDeep is an annotation‑free method for open‑vocabulary 3D scene understanding that uses a vision‑language model solely as a translator to generate structured, entity‑level descriptions of each image. These descriptions are projected and aggregated in a language‑only embedding space, eliminating the need for a 3D training corpus or domain‑specific encoder. The approach achieves competitive performance on ScanNet++ and a cultural heritage benchmark, accurately localizes out‑of‑vocabulary objects, and offers explainable, point‑level predictions.

By Thodoris Betsas, Anastasios Doulamis, Andreas Georgopoulos
arXiv Computer Vision
Oct 16

DK-VLM: Geometry as Position for Spatial Reasoning in Vision-Language Models

DK‑VLM introduces Dual‑Kernel Attention, where a visual token’s attention is computed from both its input position and its geometric position derived from 3D points and camera poses. A semantic kernel preserves pretrained attention while a geometric kernel modulates attention via point displacements and relative view transformations, with a learned gate fusing the two. The model also employs Reference‑Frame Composition supervision to update its reference frame across successive judgments, achieving top scores on six spatial benchmarks and strong performance on VSI‑Bench and ReVSI‑32.

By Han Su, Meng Tian, Tianyu Huang, Mingyu Gao, Lennox Wei, Dongxu Li, Jianhua Han, Hang Xu, Xiaohe Wu, Wangmeng Zuo