arXiv Computer Vision
3d ago

Open-Vocabulary Models and Label Propagation for Uncertainty-aware Pseudo-Labeling of Object Detection Datasets

The paper presents a semi‑supervised framework that uses open‑vocabulary object detectors to generate region proposals and semantic representations, builds an object‑level similarity graph, and propagates probabilistic labels to assign soft, uncertainty‑aware annotations to previously unlabeled objects. Experiments on four detection benchmarks show that high‑quality soft labels can be produced with only a small fraction of manual annotations, and models trained on these semi‑automatically annotated datasets achieve performance comparable to fully manually annotated models. On COCO, the method reaches 40.5% AP, nearly matching the 40.9% AP of a fully annotated model while incurring only 1% of the labeling cost.

By Jonathan Klees, Timo Heller, Matthias Rottmann
arXiv Computer Vision
Sep 21

Object Detection Benchmarks are Incomplete: The Role of Label Errors and Annotation Uncertainty

The paper demonstrates that object detection benchmarks suffer from incomplete annotations, with re-annotation of COCO, Pascal VOC, Cityscapes, and KITTI revealing up to a 60% increase in detected objects, especially small, occluded, or densely packed instances. The authors propose a scalable annotation pipeline that uses multiple annotators per object to capture uncertainty and improve recall, and they introduce two new large-scale benchmarks: an uncertainty-aware detection benchmark and a label error detection benchmark based on real errors. Their findings show that benchmark performance is highly sensitive to annotation quality, yet model rankings remain largely unchanged, highlighting the need for uncertainty-aware evaluation to better reflect real-world ambiguity.

By Sarina Penquitt, Jonathan Klees, Antonia van Betteray, Parssa Jashnieh, Peter Stehr, Matthias Rottmann, Lars Schmarje
arXiv Computer Vision
Aug 25

Data-Centric Benchmark for Label Noise Estimation and Ranking in Remote Sensing Binary Building Segmentation

arXiv:2603.00604v2 Announce Type: replace Abstract: High-quality pixel-level annotations are essential for the semantic segmentation of remote sensing imagery. However, such labels are expensive to o...

By Keiller Nogueira, Codrut-Andrei Diaconu, D\'avid Kerekes, Jakob Gawlikowski, C\'edric L\'eonard, Nassim Ait Ali Braham, June Moh Goo, Zichao Zeng, Zhipeng Liu, Pallavi Jain, Andrea Nascetti, Ronny H\"ansch
arXiv Computer Vision
Sep 3

Progressive Pseudo-Label Optimization for Point-Supervised Change Detection

The paper introduces a two-stage framework for point-supervised change detection that leverages SAM2 priors to generate object-aware candidate masks and refines them with a lightweight CNN and uncertainty-aware loss. In the second stage, a teacher‑student self‑training loop with exponential moving average updates continuously improves pseudo‑labels and model performance. Experiments on WHU-CD, LEVIR-CD, and SYSU-CD show the method surpasses prior weakly supervised approaches and competes with fully supervised ones.

By Hailong Ning, Hao Wang, Yimeng Wang, Tao Lei, Renwei Dian, Asoke K. Nandi
arXiv Machine Learning
Jun 5

In-Context Multiple Instance Learning

arXiv:2606. 06458v1 Announce Type: new Abstract: Multiple Instance Learning (MIL) addresses problems where supervision is available at the level of bags of instances and has been successfully applied in fields ranging from computational pathology to satellite imagery.

By Alexander M\"ollers, Marvin Sextro, Julius Hense, Gabriel Dernbach, Klaus-Robert M\"uller