← Back to all news
arXiv Computer Vision

OpenEarth-OVS44: A Multimodal Remote Sensing Dataset for Open-Vocabulary Segmentation

OpenEarth-OVS44 is a new multimodal remote sensing dataset featuring 290,587 expert‑verified segments from 2,832 RGB images and 1,341 RGB‑SAR pairs at sub‑meter resolution, covering 40 cities in France, Japan, and the United States. It adopts a unified 44‑class taxonomy organized into nine base categories and offers three evaluation tracks: an RGB‑only fine‑grained benchmark, a multimodal track with synthetic cloudy conditions for weather‑robust evaluation, and a held‑out cross‑region track. Experiments show that training on OpenEarth-OVS44 improves fine‑grained segmentation performance, achieving up to 7.1 mIoU points on unseen categories and 27.6 mIoU points on seen categories compared to the strongest training‑free baseline.

Related stories

arXiv AI
Aug 19

Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensing

The paper introduces OVRSISBench, a unified benchmark for open‑vocabulary remote sensing image segmentation, and evaluates existing OVS/OVRSIS models, uncovering their shortcomings in remote sensing contexts. Leveraging insights from this evaluation, the authors propose RSKT‑Seg, a new framework featuring a Multi‑Directional Cost Map Aggregation module, an Efficient Cost Map Fusion transformer, and a Remote Sensing Knowledge Transfer module. Experiments on the benchmark demonstrate that RSKT‑Seg outperforms strong baselines by +3.8 mIoU and +5.9 mACC while achieving twice the inference speed.

By Bingyu Li, Haocheng Dong, Da Zhang, Zhiyuan Zhao, Junyu Gao, Xuelong Li
llmscomputer-visionfine-tuningmultimodalbenchmarks
More like this →
Hugging Face Trending Papers
Aug 11

GeoSeg-OV: Bridging Geospatial Gaps with Structural Guidance for Open-Vocabulary Remote Sensing Segmentation

Open-vocabulary remote sensing segmentation has recently emerged as a promising paradigm that enables pixel-level recognition of arbitrary categories specified by natural language, including classes unseen during training. However, geospatial domain shifts caused by heterogeneous regions, spatial resolutions, and acquisition platforms weaken visual-text matching and limit cross-dataset generalization.

ragcomputer-visionbenchmarks
More like this →
arXiv Computer Vision
Oct 16

A large-scale climate-aware satellite image dataset for domain adaptive land-cover semantic segmentation

The paper introduces CASID, a large-scale climate‑aware satellite image dataset for land‑cover semantic segmentation, comprising 980 5,000×5,000‑pixel images from 30 Asian regions across four climate zones (temperate monsoon, subtropical monsoon, tropical monsoon, and tropical rainforest). It is the first dataset to explicitly address domain gaps caused by climatic diversity, providing detailed analyses of image features, textures, category distributions, spectral values, and object shapes for each climate domain. Extensive experiments on CASID benchmark state‑of‑the‑art segmentation and unsupervised domain adaptation methods, establishing a robust baseline for future research.

By Songlin Liu, Linwei Chen, Li Zhang, Jun Hu, Ying Fu
computer-visionfine-tuning
More like this →
arXiv Computer Vision
Sep 25

RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation

RGBD20K is a new large-scale RGB‑D semantic segmentation dataset featuring 20,000 image pairs and 160 fine‑grained categories, surpassing existing benchmarks like NYUv2 and SUN RGB‑D in both scale and semantic diversity. The dataset provides high‑fidelity annotations obtained through rigorous re‑evaluation and correction of prior labels, ensuring a clean ground‑truth foundation. Additionally, the authors introduce a score‑purified fusion (SPF) method that achieves state‑of‑the‑art performance across evaluated benchmarks, demonstrating the value of high‑quality multimodal information.

By Shaohua Dong, Zexuan Meng, Haiyan Sun, Bing Fan, Cuicui Zhang, Dylan Joseph, Kewei Sha, Yunhe Feng, Heng Fan
computer-visionmultimodalbenchmarks
More like this →
arXiv Computer Vision
Oct 12

Intra- and Cross-Scale Feature Interaction Network for Referring Remote Sensing Image Segmentation

The paper introduces NWPU-Refer, the largest bilingual dataset for referring remote sensing image segmentation, featuring 15,003 high‑resolution images from over 30 countries and 49,745 annotated targets. It also proposes the Multi‑scale Referring Segmentation Network (MRSNet), which uses an Intra‑scale Feature Interaction Module to refine fine‑grained features and a Hierarchical Feature Interaction Module to fuse cross‑scale information while preserving spatial structure. Experiments on NWPU‑Refer and RRSIS‑D show that MRSNet achieves strong, competitive performance, especially under strict IoU thresholds, demonstrating the effectiveness of both the new dataset and the model.

By Zhigang Yang, Huiguang Yao, Linmao Tian, Xuezhi Zhao, Qiang Li, Qi Wang
computer-visionmultimodal
More like this →
arXiv AI
Jun 2

CAFOSat: A Strongly Annotated Dataset for Infrastructure-Aware CAFO Mapping Using High-Resolution Imagery

arXiv:2606. 00548v1 Announce Type: cross Abstract: Concentrated Animal Feeding Operations (CAFOs) play an important role in agricultural production but are also associated with environmental, public health, and disease surveillance concerns.

By Oishee Bintey Hoque, Nibir Chandra Mandal, Mandy L Wilson, Samarth Swarup, Madhav Marathe, Abhijin Adiga
llmsmultimodalbenchmarks
More like this →
arXiv AI
Aug 3

Leveraging Image Generators to Address Data Scarcity: The Gen4Regen Dataset for Forest Regeneration Mapping

arXiv:2605. 05627v2 Announce Type: replace-cross Abstract: Sustainable forest management relies on precise species composition mapping, yet traditional ground surveys are labour-intensive and geographically constrained.

By Gabriel Jeanson, David-Alexandre Duclos, William Larriv\'ee-Hardy, No\'e Cochet, Mat\v{e}j Boxan, Anthony Desch\^enes, Fran\c{c}ois Pomerleau, Philippe Gigu\`ere
computer-vision
More like this →