arXiv Computer Vision

When GeoFMs Meet VHR: Benchmarking Foundation Models on Very High Resolution Earth Observation Imagery

The paper introduces VHR-Bench, a benchmark of ten very high resolution (VHR) Earth observation datasets, and evaluates twelve encoders pretrained under different regimes. Results show that both large natural‑image pretraining and VHR‑specific pretraining transfer well to VHR tasks, with SkySense excelling when labels are scarce and DINOv3 ViT‑L performing best with full labels. Continuing self‑supervised pretraining of DINOv3 on VHR tiles further improves performance, especially in low‑label scenarios, without extra inference cost.

arXiv AI
Sep 1

A Composition-Aware Pretraining Framework for Geospatial Foundation Models

The paper introduces a composition‑aware pretraining framework for geospatial foundation models that explicitly encodes fractional land‑cover mixtures as histogram targets for each satellite image cell. By using Earth Mover’s Distance to distill these composition targets into a 36.8 M‑parameter backbone, the authors demonstrate significant improvements on region‑level tasks such as zero‑shot image retrieval and scene classification, while maintaining competitive performance on fine‑grained tasks like segmentation and object detection. The method outperforms larger models (SatMAE and Prithvi‑EO‑2.0) and achieves a 55.6 % relative boost on the ForestNet‑12 dataset, evidencing the benefit of explicit composition modeling.

By Aryan Kashyap Naveen, Abhishek Srinivas, Pranav Moothedath, Shrutilipi Bhattacharjee
arXiv Computer Vision
Aug 28

SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation

SIMPLER is a pre‑fine‑tuning method that reduces inference and deployment costs for Earth Observation foundation models by pruning redundant layers. It uses layer‑wise representation similarity on unlabeled task data to identify and remove up to 79% of parameters without requiring gradients, magnitude heuristics, or hyperparameter tuning. Experiments on Prithvi‑EO‑2, TerraMind, and ImageNet‑pretrained ViT‑MAE show that SIMPLER retains 94% of baseline performance while achieving 2.1× faster training and 2.6× faster inference.

By V\'ictor Barreiro, Johannes Jakubik, Francisco Arg\"uello, Dora B. Heras
arXiv Computer Vision
Oct 16

Data-Efficient ConvNeXt Pretraining for High-Resolution Sentinel-1 GRD SAR Representation Learning

The paper introduces SparK-SAR, a sparse convolutional masked pretraining framework that leverages ConvNeXt for high‑resolution Sentinel‑1 GRD SAR data. It presents three key contributions: a domain‑adapted ConvNeXt‑RS encoder with a reduced stem stride, a lightweight ConvNeXt‑512 decoder that cuts VRAM usage while matching UNet accuracy, and an analysis of FP16 instability and layer‑wise learning‑rate decay benefits. Experiments on four Copernicus‑Bench S1GRD tasks show that the 27.8 M‑parameter ConvNeXt‑RS encoder outperforms a larger ViT baseline on most tasks and demonstrates strong data efficiency, with classification saturating at 10–25 % of the SSL4EO‑S12 corpus.

By Yuki Natsume, Sang-Ho Yun, Chai Kiat Yeo
arXiv Computer Vision
Sep 24

VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing

The paper introduces RSMEB, a unified benchmark for remote‑sensing multimodal retrieval that evaluates both cross‑modal and interleaved retrieval across 21 tasks under a single ranking protocol. It also presents VLM2GeoVec, an instruction‑conditioned single‑encoder model that embeds image, text, bounding‑box, and geo‑coordinate tokens into one sequence and achieves state‑of‑the‑art performance on region‑caption, referring‑expression, and semantic geo‑aware retrieval while remaining competitive on conventional tasks. The authors provide code, checkpoints, and data on GitHub to facilitate reproducibility.

By Emanuel S\'anchez Aimar, Gulnaz Zhambulova, Fahad Shahbaz Khan, Yonghao Xu, Michael Felsberg
Hugging Face Trending Papers
Aug 11

GeoSeg-OV: Bridging Geospatial Gaps with Structural Guidance for Open-Vocabulary Remote Sensing Segmentation

Open-vocabulary remote sensing segmentation has recently emerged as a promising paradigm that enables pixel-level recognition of arbitrary categories specified by natural language, including classes unseen during training. However, geospatial domain shifts caused by heterogeneous regions, spatial resolutions, and acquisition platforms weaken visual-text matching and limit cross-dataset generalization.

arXiv AI
6d ago

FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales

FLORO is a multimodal geospatial foundation model that learns transferable representations from a small but diverse remote sensing corpus, including Sentinel-1, Sentinel-2, SkySAT imagery, elevation, and UAV data. It uses masked autoencoding and availability‑aware inputs to handle varying sensor configurations, enabling a unified input space across heterogeneous modalities. Evaluated on the PANGAEA benchmark, FLORO achieved strong, stable transfer performance across scene classification, segmentation, and regression tasks, ranking second in segmentation and third in scene classification while excelling in regression tasks.

By Jorge L. Rodriguez, Victor Angulo Morales, Areej Alwahas, Mariana Elias Lara, Fida Mohammad Thoker, Kasper Johansen, Bernard Ghanem, Fernando T. Maestre, Matthew F. McCabe
arXiv AI
Aug 10

SLED: Scalable Location Encoding via Distillation

arXiv:2608. 06612v1 Announce Type: cross Abstract: The plethora of readily available geospatial data offers exciting opportunities to learn high quality representations of the planet, but the sheer size of the Earth Observations (EO), differing modalities, and different sensor types pose significant challenges in doing so.

By Kevin Lane, Zhongying Wang, Esther Rolf, Morteza Karimzadeh
arXiv AI
Jun 2

Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration

arXiv:2605. 00310v2 Announce Type: replace-cross Abstract: Super-resolution (SR) techniques have made major advances in reconstructing high-resolution images from low-resolution inputs.

By Zhili Li, Kangyang Chai, Zhihao Wang, Xiaowei Jia, Yanhua Li, Gengchen Mai, Sergii Skakun, Dinesh Manocha, Yiqun Xie
arXiv AI
Aug 18

Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentation

arXiv:2608. 15647v1 Announce Type: cross Abstract: Semantic segmentation of very-high-resolution (VHR) remote sensing imagery increasingly benefits from strong pretrained hierarchical encoders, yet exploiting their multi-stage representations remains difficult.

By Shuaishuai Cao, Meng Tang, Shuwei Peng, Xuan Liu, Min Huang, Jie Chen, Jiacheng Niu, Yong Chen, Edore Akpokodje, Hui Lin