arXiv Computer Vision

OBB-PBD: Extending Parallel Box Decoding to Oriented Bounding Boxes for Referring Expression Grounding in Aerial Imagery

arXiv Computer Vision
Sep 24

A Unified Framework and Dataset for Oriented Object Visual Grounding in Remote Sensing

The paper introduces O$^2$-VG, a unified framework for oriented object visual grounding in remote sensing images, comprising three complementary models: O$^2$-VG-Trans, a cross‑modality transformer; O$^2$-VG-Uni, which predicts universal oriented proposals; and O$^2$-VG-VLM, an autoregressive vision‑language model that generates oriented bounding boxes. It also presents DIOR‑R‑SVG, a new dataset containing image, expression, and oriented box triplets for training and evaluation. The framework demonstrates superior performance across multiple benchmarks and is supported by publicly available code.

By Zeyu Ding, Yong Zhou, Jiaqi Zhao, Wen-Liang Du, Xixi Li, Hancheng Zhu, Rui Yao, Abdulmotaleb El Saddik
arXiv Computer Vision
2d ago

High-fidelity training-free photovoltaic module mapping from multi-view UAV imagery

The paper introduces MV-PVMapper, a training‑free framework that combines vision foundation models (SAM 3) with UAV photogrammetry to produce high‑fidelity maps of photovoltaic modules. By generating candidate contours, correcting for surface slope, and iteratively refining segmentation across multiple views, the method recovers 7,710 of 7,711 modules with no false positives and achieves macro‑averaged precision and recall above 98 %. The approach outperforms orthomosaic segmentation and multi‑view pixel‑voting baselines, reaching a Jaccard index of 97.55 % without any task‑specific training data.

By WenHao Duan, Qi Chen, Penglei Zhang, Ruizhe Deng, Zhiling Guo, Haoran Zhang, Yuntian Chen
arXiv Computer Vision
Sep 24

Groundbench: Multi-Resolution Polygon Grounding Exposes the Geometry Gap in Vision-Language Models

Groundbench is a new benchmark that evaluates vision‑language models on multi‑resolution polygon grounding, using the same 1,500 image‑expression‑referent triples but targeting exact‑N polygons with five different vertex budgets. It audits both filled‑region intersection‑over‑union (IoU) and legal‑polygon completion, revealing that the best models achieve 88.2 box IoU and 97.1 accuracy at IoU ≥ 0.5, while direct polygon predictions lag at 57.7 and 69.2. The study shows performance is non‑monotonic across budgets, collapses at the densest budget due to legality failures, and highlights that false spatial cues hurt more than false colour cues, underscoring an operational geometry gap beyond latent boundary perception.

By Zhonghan Bian, Zhenran Wang, Jinsong Li, Zhangyang Qi
arXiv Computer Vision
Oct 12

Jag: Direct Box Prediction for Efficient Visual Grounding

Jag is a method that transforms a compact pretrained multimodal model into a direct box predictor for visual grounding. It adds a lightweight regression head that, conditioned on the image and referring expression, outputs all four box coordinates in a single forward pass without sequential decoding. Geometric supervision jointly fine‑tunes the language backbone, visual merger, and regression head, leading to improved accuracy and lower latency compared to existing specialized grounding models.

By Xiuyuan Zhu, Ke Lu, Hao Wu, Zijin Du, Dongming Zhang, Jian Xue
arXiv Machine Learning
Jun 3

WildRoadBench: A Wild Aerial Road-Damage Grounding Benchmark for Vision-Language Models and Autonomous Agents

arXiv:2605. 20306v2 Announce Type: replace-cross Abstract: We introduce WildRoadBench, a wild aerial road-damage grounding benchmark that couples direct visual grounding by vision-language models with autonomous research-and-engineering by LLM-driven agents on a single professionally annotated UAV corpus.

By Bingnan Liu, Chenhang Cui, Rui Huang, Jiani Luo, Zhirong Shen, Tinghao Wang, Xiande Huang, Lingbei Meng, Fei Shen, An Zhang
arXiv Machine Learning
Sep 4

Towards Lifelong Aerial Autonomy: Geometric Memory Management for Continual Visual Place Recognition in Dynamic Environments

The paper addresses lifelong aerial autonomy by treating visual place recognition (VPR) as a mission‑based domain‑incremental learning problem. It introduces a heterogeneous memory framework that first trains on a static satellite exemplar memory and then uses a bounded replay buffer to retain selected airborne observations across missions. The proposed DBS‑Hybrid replay strategy, which blends prototype‑based diversity trimming with representative‑first feature‑space coverage, outperforms baseline methods in accuracy, generalization, and knowledge retention across multiple UAV missions.

By Xingyu Shao, Zhiqiang Yan, Liangzheng Sun, Mengfan He, Chao Chen, Jinhui Zhang, Chunyu Li, Ziyang Meng
arXiv Computer Vision
Sep 24

SGDet3D++: Geometry-Grounded Semantics for 4D Radar and Camera 3D Object Detection

SGDet3D++ introduces a geometry‑grounded approach to 4D radar‑camera 3D object detection by explicitly conditioning evidence on evolving object hypotheses. It employs Anchor‑Grounded Semantic Retrieval, Geometry‑Consistent Anchor Refinement, and Doppler‑Verified Correspondence to filter and align semantic, geometric, and temporal cues before updating queries. The method achieves significant performance gains on OmniHD‑Scenes, ManTruckScenes, and TJ4DRadSet, with detailed ablations showing improvements in occlusion handling, target‑return purity, and motion consistency.

By Xiaokai Bai, Zhenyu Fan, Lianqing Zheng, Songkai Wang, Si-Yuan Cao, Hui-liang Shen
arXiv AI
Oct 2

CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement

CoEvolve is a construct-to-edit framework for visual grounding that separates the task into explicit state construction and state editing. It uses Region‑Evolution Reinforcement to progressively refine candidate regions and Bidirectional Denoising Refiner to adjust coordinate fields based on fixed semantic context. The approach achieves high grounding accuracy with a 9B backbone, rivaling much larger models, and can recover over 27 percentage points in mean box overlap after a single refinement pass.

By Dongwei Sun, Yujie Zhang, Bowen Yao, Pei Liu, Jing Yao, Xiangyong Cao