OBB-PBD: Extending Parallel Box Decoding to Oriented Bounding Boxes for Referring Expression Grounding in Aerial Imagery
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Referring expression grounding in overhead imagery requires oriented bounding boxes rather than horizontal ones, since aerial objects appear at arbitrary orientations. Most grounding models emit box c...
The paper introduces O$^2$-VG, a unified framework for oriented object visual grounding in remote sensing images, comprising three complementary models: O$^2$-VG-Trans, a cross‑modality transformer; O$^2$-VG-Uni, which predicts universal oriented proposals; and O$^2$-VG-VLM, an autoregressive vision‑language model that generates oriented bounding boxes. It also presents DIOR‑R‑SVG, a new dataset containing image, expression, and oriented box triplets for training and evaluation. The framework demonstrates superior performance across multiple benchmarks and is supported by publicly available code.
The paper introduces MV-PVMapper, a training‑free framework that combines vision foundation models (SAM 3) with UAV photogrammetry to produce high‑fidelity maps of photovoltaic modules. By generating candidate contours, correcting for surface slope, and iteratively refining segmentation across multiple views, the method recovers 7,710 of 7,711 modules with no false positives and achieves macro‑averaged precision and recall above 98 %. The approach outperforms orthomosaic segmentation and multi‑view pixel‑voting baselines, reaching a Jaccard index of 97.55 % without any task‑specific training data.
Groundbench is a new benchmark that evaluates vision‑language models on multi‑resolution polygon grounding, using the same 1,500 image‑expression‑referent triples but targeting exact‑N polygons with five different vertex budgets. It audits both filled‑region intersection‑over‑union (IoU) and legal‑polygon completion, revealing that the best models achieve 88.2 box IoU and 97.1 accuracy at IoU ≥ 0.5, while direct polygon predictions lag at 57.7 and 69.2. The study shows performance is non‑monotonic across budgets, collapses at the densest budget due to legality failures, and highlights that false spatial cues hurt more than false colour cues, underscoring an operational geometry gap beyond latent boundary perception.
Jag is a method that transforms a compact pretrained multimodal model into a direct box predictor for visual grounding. It adds a lightweight regression head that, conditioned on the image and referring expression, outputs all four box coordinates in a single forward pass without sequential decoding. Geometric supervision jointly fine‑tunes the language backbone, visual merger, and regression head, leading to improved accuracy and lower latency compared to existing specialized grounding models.
arXiv:2605. 20306v2 Announce Type: replace-cross Abstract: We introduce WildRoadBench, a wild aerial road-damage grounding benchmark that couples direct visual grounding by vision-language models with autonomous research-and-engineering by LLM-driven agents on a single professionally annotated UAV corpus.