arXiv Computer Vision

ReA-OVCD: Training-Free Open-Vocabulary Change Detection via Semantic-Spatial Reliability Assessment

arXiv Computer Vision
Sep 24

From Change Captions to Change Detection: Semantic-Appearance Agreement Framework for Remote Sensing Change Detection

The paper proposes a weakly supervised remote sensing change detection method that uses change captions as the sole supervision signal, eliminating the need for pixel‑level change masks. It introduces a caption‑driven generation pipeline to create bi‑temporal image pairs with controlled changes and a Semantic‑Appearance Agreement Framework (SAAF) that fuses caption‑grounded semantic responses with RGB differences for accurate change localization. Experiments on the Flair‑RSGen and WHU‑CDC datasets demonstrate that SAAF outperforms existing limited‑supervision baselines in macro‑averaged IoU and F1 metrics.

By Yuan Qian, Jie Ma
arXiv Computer Vision
Oct 22

OpenEarth-OVS44: A Multimodal Remote Sensing Dataset for Open-Vocabulary Segmentation

OpenEarth-OVS44 is a new multimodal remote sensing dataset featuring 290,587 expert‑verified segments from 2,832 RGB images and 1,341 RGB‑SAR pairs at sub‑meter resolution, covering 40 cities in France, Japan, and the United States. It adopts a unified 44‑class taxonomy organized into nine base categories and offers three evaluation tracks: an RGB‑only fine‑grained benchmark, a multimodal track with synthetic cloudy conditions for weather‑robust evaluation, and a held‑out cross‑region track. Experiments show that training on OpenEarth-OVS44 improves fine‑grained segmentation performance, achieving up to 7.1 mIoU points on unseen categories and 27.6 mIoU points on seen categories compared to the strongest training‑free baseline.

By Yimin Wei, Hongruixuan Chen, Hao Zheng, Hao Liu, Jian Song, Yuting Zhu, Junshi Xia, Naoto Yokoya
arXiv AI
Aug 19

Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensing

The paper introduces OVRSISBench, a unified benchmark for open‑vocabulary remote sensing image segmentation, and evaluates existing OVS/OVRSIS models, uncovering their shortcomings in remote sensing contexts. Leveraging insights from this evaluation, the authors propose RSKT‑Seg, a new framework featuring a Multi‑Directional Cost Map Aggregation module, an Efficient Cost Map Fusion transformer, and a Remote Sensing Knowledge Transfer module. Experiments on the benchmark demonstrate that RSKT‑Seg outperforms strong baselines by +3.8 mIoU and +5.9 mACC while achieving twice the inference speed.

By Bingyu Li, Haocheng Dong, Da Zhang, Zhiyuan Zhao, Junyu Gao, Xuelong Li
Hugging Face Trending Papers
4d ago

HyperFlow: Class-Incremental Semantic Change Detection via Hyperbolic Flow

HyperFlow is a method for class‑incremental semantic change detection in remote sensing, allowing a model to progressively learn new types of land‑cover changes. It leverages the hierarchical nature of land‑cover semantics by embedding categories in hyperbolic space and uses Busemann prototypes to model change as an anomaly in a learned semantic flow. The authors also introduce HiChange, a large‑scale dataset with fine‑grained hierarchical labels, and show that incremental refinement of categories improves both change detection and segmentation performance.