arXiv Computer Vision
Sep 24

From Change Captions to Change Detection: Semantic-Appearance Agreement Framework for Remote Sensing Change Detection

The paper proposes a weakly supervised remote sensing change detection method that uses change captions as the sole supervision signal, eliminating the need for pixel‑level change masks. It introduces a caption‑driven generation pipeline to create bi‑temporal image pairs with controlled changes and a Semantic‑Appearance Agreement Framework (SAAF) that fuses caption‑grounded semantic responses with RGB differences for accurate change localization. Experiments on the Flair‑RSGen and WHU‑CDC datasets demonstrate that SAAF outperforms existing limited‑supervision baselines in macro‑averaged IoU and F1 metrics.

By Yuan Qian, Jie Ma
arXiv Computer Vision
Oct 22

OpenEarth-OVS44: A Multimodal Remote Sensing Dataset for Open-Vocabulary Segmentation

OpenEarth-OVS44 is a new multimodal remote sensing dataset featuring 290,587 expert‑verified segments from 2,832 RGB images and 1,341 RGB‑SAR pairs at sub‑meter resolution, covering 40 cities in France, Japan, and the United States. It adopts a unified 44‑class taxonomy organized into nine base categories and offers three evaluation tracks: an RGB‑only fine‑grained benchmark, a multimodal track with synthetic cloudy conditions for weather‑robust evaluation, and a held‑out cross‑region track. Experiments show that training on OpenEarth-OVS44 improves fine‑grained segmentation performance, achieving up to 7.1 mIoU points on unseen categories and 27.6 mIoU points on seen categories compared to the strongest training‑free baseline.

By Yimin Wei, Hongruixuan Chen, Hao Zheng, Hao Liu, Jian Song, Yuting Zhu, Junshi Xia, Naoto Yokoya