arXiv Computer Vision
Sep 24

A Unified Framework and Dataset for Oriented Object Visual Grounding in Remote Sensing

The paper introduces O$^2$-VG, a unified framework for oriented object visual grounding in remote sensing images, comprising three complementary models: O$^2$-VG-Trans, a cross‑modality transformer; O$^2$-VG-Uni, which predicts universal oriented proposals; and O$^2$-VG-VLM, an autoregressive vision‑language model that generates oriented bounding boxes. It also presents DIOR‑R‑SVG, a new dataset containing image, expression, and oriented box triplets for training and evaluation. The framework demonstrates superior performance across multiple benchmarks and is supported by publicly available code.

By Zeyu Ding, Yong Zhou, Jiaqi Zhao, Wen-Liang Du, Xixi Li, Hancheng Zhu, Rui Yao, Abdulmotaleb El Saddik
arXiv Computer Vision
2d ago

High-fidelity training-free photovoltaic module mapping from multi-view UAV imagery

The paper introduces MV-PVMapper, a training‑free framework that combines vision foundation models (SAM 3) with UAV photogrammetry to produce high‑fidelity maps of photovoltaic modules. By generating candidate contours, correcting for surface slope, and iteratively refining segmentation across multiple views, the method recovers 7,710 of 7,711 modules with no false positives and achieves macro‑averaged precision and recall above 98 %. The approach outperforms orthomosaic segmentation and multi‑view pixel‑voting baselines, reaching a Jaccard index of 97.55 % without any task‑specific training data.

By WenHao Duan, Qi Chen, Penglei Zhang, Ruizhe Deng, Zhiling Guo, Haoran Zhang, Yuntian Chen
arXiv Computer Vision
Sep 24

Groundbench: Multi-Resolution Polygon Grounding Exposes the Geometry Gap in Vision-Language Models

Groundbench is a new benchmark that evaluates vision‑language models on multi‑resolution polygon grounding, using the same 1,500 image‑expression‑referent triples but targeting exact‑N polygons with five different vertex budgets. It audits both filled‑region intersection‑over‑union (IoU) and legal‑polygon completion, revealing that the best models achieve 88.2 box IoU and 97.1 accuracy at IoU ≥ 0.5, while direct polygon predictions lag at 57.7 and 69.2. The study shows performance is non‑monotonic across budgets, collapses at the densest budget due to legality failures, and highlights that false spatial cues hurt more than false colour cues, underscoring an operational geometry gap beyond latent boundary perception.

By Zhonghan Bian, Zhenran Wang, Jinsong Li, Zhangyang Qi
arXiv Computer Vision
Oct 12

Jag: Direct Box Prediction for Efficient Visual Grounding

Jag is a method that transforms a compact pretrained multimodal model into a direct box predictor for visual grounding. It adds a lightweight regression head that, conditioned on the image and referring expression, outputs all four box coordinates in a single forward pass without sequential decoding. Geometric supervision jointly fine‑tunes the language backbone, visual merger, and regression head, leading to improved accuracy and lower latency compared to existing specialized grounding models.

By Xiuyuan Zhu, Ke Lu, Hao Wu, Zijin Du, Dongming Zhang, Jian Xue
arXiv Machine Learning
Jun 3

WildRoadBench: A Wild Aerial Road-Damage Grounding Benchmark for Vision-Language Models and Autonomous Agents

arXiv:2605. 20306v2 Announce Type: replace-cross Abstract: We introduce WildRoadBench, a wild aerial road-damage grounding benchmark that couples direct visual grounding by vision-language models with autonomous research-and-engineering by LLM-driven agents on a single professionally annotated UAV corpus.

By Bingnan Liu, Chenhang Cui, Rui Huang, Jiani Luo, Zhirong Shen, Tinghao Wang, Xiande Huang, Lingbei Meng, Fei Shen, An Zhang