arXiv AI

Occlusion for Free: Detecting Occlusion from the Disagreement Between Two Monocular Distance Cues

The paper demonstrates that occlusion can be inferred from the disagreement between two monocular distance cues—apparent height and metric depth—without requiring any occlusion labels or training. By comparing the ordering of these cues, the authors achieve high occlusion detection performance on KITTI and synthetic CARLA scenes, outperforming distance alone. The method relies only on a camera‑only pipeline and a depth model whose errors are close to a pure gain, a condition that can be verified without labels.

arXiv Computer Vision
Sep 18

Open-vocabulary 3D object detection with promptable segmentation

The paper introduces an open‑vocabulary 3D object detection pipeline that uses a promptable segmentation model (SAM3) to generate instance masks from six surround‑view cameras. These masks are converted into metric 3D boxes, achieving up to 0.413 mAP/0.555 NDS without any training when supervised box geometry is borrowed at inference. The approach also improves a supervised LiDAR‑only detector by 0.034 mAP through a camera‑witness rule, demonstrating that measurement precision, not 2D detection, limits performance.

By \"Omer Faruk Deniz, Mustafa Taha Ko\c{c}yi\u{g}it
arXiv AI
Aug 26

Syn2RealTrack: Bridging the Gap Between Synthetic and Real-World Datasets for Online Multi-View Multi-Target Tracking

Syn2RealTrack addresses the synthetic‑to‑real gap in multi‑camera 3D perception for warehouses by decomposing it into three distinct issues: camera calibration, object shape prior, and known object census. The pipeline corrects lens distortion from images, fuses detections with a visibility‑weighted part‑based descriptor, measures person height directly from calibration, and uses a closed‑world cardinality prior with a causal filter to eliminate phantom boxes. These local remedies allow the system to adapt without retraining a feature extractor, achieving a 3D HOTA of 52.0118% on the AI City Challenge 2026 Track 1.

By Duong Nguyen-Ngoc Tran, Ngoc Doan-Minh Huynh, Cu Quoc Le, Hoang-Khang Nguyen, Long Hoang Pham, Huy-Hung Nguyen, Quoc Pham-Nam Ho, Trinh Le Ba Khanh, Chi Dai Tran, Duong Khac Vu, Son Hong Phan, Hyung-Min Jeon, Jae Wook Jeon
arXiv AI
Sep 2

VOIM: Training-Free Open-Vocabulary 3D Instance Mapping for RGB-D and Monocular SLAM

VOIM (Voxel‑Grounded Online Instance Manager) is a training‑free system that builds open‑vocabulary 3D instance maps from RGB‑D or monocular RGB input by deferring label and instance decisions until sufficient soft evidence accumulates per voxel across views. Across four perception configurations on ScanNet++, VOIM outperforms the strongest online RGB‑D system, OVO‑SLAM, by 4.8–11.7 mIoU, and achieves 44.07 mIoU under a like‑for‑like protocol, winning all ten scenes. The method also runs unchanged on monocular RGB, matching baseline performance on Replica, and produces exportable occupancy grids that support free‑form instance queries.

By Sangmin Song, Sarath Kodagoda, Marc G. Carmichael, Karthick Thiyagarajan, Amal Gunatilake, Kelly Prentice, Jodi Martin
arXiv Computer Vision
Sep 25

Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models

The paper introduces a tool‑augmented framework that enhances a small Vision‑Language Model (Qwen3.5‑4B) with geometric tools—3D object detection, metric depth estimation, and deterministic solvers for distance, size, and bearing—to improve metric spatial reasoning. By moving metric computation from the model’s weights into explicit solvers, the approach achieves significant gains on ReVSI‑Bench tasks, notably increasing absolute distance accuracy from 0.46 to 0.74 MRA and relative direction accuracy from 25.9% to 73.4%. The modular design allows swapping in different detectors, enabling a clear separation between perception and reasoning errors, and the model can autonomously sequence the tools to match a scripted pipeline on most tasks.

By Kai Glantz, Clemens Grange
arXiv Machine Learning
Aug 31

Depth-Aware Pothole Detection Using YOLO and RT-DETR at the Edge

The paper introduces a depth‑aware pothole detection framework that fuses RGB‑D sensor data and evaluates five architectures—YOLOv8n, YOLOv8nSeg, YOLOv9t, RTDETRL, and RTDETRX—on the PothRGBD dataset. YOLOv8nSeg achieves the highest detection performance (mAP@50 = 0.9556, mAP@50_95 = 0.6758) and the most accurate depth estimate (2.96 cm), while YOLOv8n offers the fastest inference (3.6 ms) and RTDETRX delivers the highest detection confidence (92.70 %). The study also shows that even after RANSAC orthorectification, bounding‑box models overestimate pothole depth by 0.16–0.21 cm, indicating a structural bias rather than a calibration error.

By Md Monjurul Ahsan Prodhan, Md Nour Hossain