arXiv Computer Vision By Kshitij Raj Sharma, Pierre Adorni, Minh-Tan Pham, Dirk Tiede, S\'ebastien Lef\`evre

When GeoFMs Meet VHR: Benchmarking Foundation Models on Very High Resolution Earth Observation Imagery

Read the original on arXiv Computer Vision →

The paper introduces VHR-Bench, a benchmark of ten very high resolution (VHR) Earth observation datasets, and evaluates twelve encoders pretrained under different regimes. Results show that both large natural‑image pretraining and VHR‑specific pretraining transfer well to VHR tasks, with SkySense excelling when labels are scarce and DINOv3 ViT‑L performing best with full labels. Continuing self‑supervised pretraining of DINOv3 on VHR tiles further improves performance, especially in low‑label scenarios, without extra inference cost.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 1

A Composition-Aware Pretraining Framework for Geospatial Foundation Models

The paper introduces a composition‑aware pretraining framework for geospatial foundation models that explicitly encodes fractional land‑cover mixtures as histogram targets for each satellite image cell. By using Earth Mover’s Distance to distill these composition targets into a 36.8 M‑parameter backbone, the authors demonstrate significant improvements on region‑level tasks such as zero‑shot image retrieval and scene classification, while maintaining competitive performance on fine‑grained tasks like segmentation and object detection. The method outperforms larger models (SatMAE and Prithvi‑EO‑2.0) and achieves a 55.6 % relative boost on the ForestNet‑12 dataset, evidencing the benefit of explicit composition modeling.

By Aryan Kashyap Naveen, Abhishek Srinivas, Pranav Moothedath, Shrutilipi Bhattacharjee
arXiv Computer Vision
Aug 28

SIMPLER: Efficient Foundation Model Adaptation via Similarity-Guided Layer Pruning for Earth Observation

SIMPLER is a pre‑fine‑tuning method that reduces inference and deployment costs for Earth Observation foundation models by pruning redundant layers. It uses layer‑wise representation similarity on unlabeled task data to identify and remove up to 79% of parameters without requiring gradients, magnitude heuristics, or hyperparameter tuning. Experiments on Prithvi‑EO‑2, TerraMind, and ImageNet‑pretrained ViT‑MAE show that SIMPLER retains 94% of baseline performance while achieving 2.1× faster training and 2.6× faster inference.

By V\'ictor Barreiro, Johannes Jakubik, Francisco Arg\"uello, Dora B. Heras
arXiv Computer Vision
Oct 16

Data-Efficient ConvNeXt Pretraining for High-Resolution Sentinel-1 GRD SAR Representation Learning

The paper introduces SparK-SAR, a sparse convolutional masked pretraining framework that leverages ConvNeXt for high‑resolution Sentinel‑1 GRD SAR data. It presents three key contributions: a domain‑adapted ConvNeXt‑RS encoder with a reduced stem stride, a lightweight ConvNeXt‑512 decoder that cuts VRAM usage while matching UNet accuracy, and an analysis of FP16 instability and layer‑wise learning‑rate decay benefits. Experiments on four Copernicus‑Bench S1GRD tasks show that the 27.8 M‑parameter ConvNeXt‑RS encoder outperforms a larger ViT baseline on most tasks and demonstrates strong data efficiency, with classification saturating at 10–25 % of the SSL4EO‑S12 corpus.

By Yuki Natsume, Sang-Ho Yun, Chai Kiat Yeo
arXiv Computer Vision
Sep 24

VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing

The paper introduces RSMEB, a unified benchmark for remote‑sensing multimodal retrieval that evaluates both cross‑modal and interleaved retrieval across 21 tasks under a single ranking protocol. It also presents VLM2GeoVec, an instruction‑conditioned single‑encoder model that embeds image, text, bounding‑box, and geo‑coordinate tokens into one sequence and achieves state‑of‑the‑art performance on region‑caption, referring‑expression, and semantic geo‑aware retrieval while remaining competitive on conventional tasks. The authors provide code, checkpoints, and data on GitHub to facilitate reproducibility.

By Emanuel S\'anchez Aimar, Gulnaz Zhambulova, Fahad Shahbaz Khan, Yonghao Xu, Michael Felsberg