arXiv AI

Background-Free Objectness Learning for Class-Agnostic Detection

Background-Free Objectness Learning (B-FOR) is a dense, class‑agnostic detection framework that learns objectness without treating unlabeled regions as background. It predicts multi‑scale object‑center and scale fields, using spatially structured soft targets to supervise only reliable annotated areas and introduces displacement‑aware scale fields to model object extent. Experiments on PASCAL VOC, MS‑COCO, and Open Images show B‑FOR improves recall by over +10 AR points compared to prior class‑agnostic baselines, with ablation studies confirming the importance of localized supervision and displacement‑aware scaling.

arXiv Machine Learning
Aug 20

SPK: Eliciting Structured Prior Knowledge for Interpretable Out-of-Distribution Detection in Real-Time Object Detection

The paper introduces Structured Prior Knowledge (SPK), a framework that extracts and organizes latent priors from pretrained object detectors to improve out-of-distribution (OoD) detection. SPK uses in-distribution data and hallucination-inducing samples to elicit part-level semantic concepts, then combines these with geometric and contextual priors into a compact five-dimensional representation. Experiments across various detector architectures and OoD benchmarks show that SPK achieves state-of-the-art performance, demonstrating that pretrained detectors encode richer latent knowledge than previously exploited.

By Changshun Wu, Weicheng He, Xiaowei Huang, Saddek Bensalem
arXiv Computer Vision
Sep 7

Object Concepts Emerge from Motion

The paper introduces a biologically inspired framework that learns object‑centric visual representations from raw videos without human annotations or camera calibration. By using motion boundaries detected via optical flow and clustering to create pseudo‑instance masks, the method supervises a single‑image encoder with pixel‑level pairwise metric learning. Training on 195 million pseudo‑labeled frames and expanding to 421 million frames through Motion‑Verified Self‑Training, the approach yields Swin‑based encoders that outperform or match supervised and self‑supervised baselines on tasks such as monocular depth estimation, 3D object detection, 3D occupancy prediction, and end‑to‑end planning.

By Boshi Li, Xiaohui Wang, Xiaoyang Wu, Zhichao Li, Ya Yang, Naiyan Wang
arXiv Computer Vision
3d ago

Open-Vocabulary Models and Label Propagation for Uncertainty-aware Pseudo-Labeling of Object Detection Datasets

The paper presents a semi‑supervised framework that uses open‑vocabulary object detectors to generate region proposals and semantic representations, builds an object‑level similarity graph, and propagates probabilistic labels to assign soft, uncertainty‑aware annotations to previously unlabeled objects. Experiments on four detection benchmarks show that high‑quality soft labels can be produced with only a small fraction of manual annotations, and models trained on these semi‑automatically annotated datasets achieve performance comparable to fully manually annotated models. On COCO, the method reaches 40.5% AP, nearly matching the 40.9% AP of a fully annotated model while incurring only 1% of the labeling cost.

By Jonathan Klees, Timo Heller, Matthias Rottmann