arXiv AI
Jun 19

TerraMind: Large-Scale Generative Multimodality for Earth Observation

arXiv:2504. 11171v5 Announce Type: replace-cross Abstract: We present TerraMind, the first any-to-any generative, multimodal foundation model for Earth observation (EO).

By Johannes Jakubik, Felix Yang, Benedikt Blumenstiel, Erik Scheurer, Rocco Sedona, Stefano Maurogiovanni, Jente Bosmans, Nikolaos Dionelis, Valerio Marsocci, Niklas Kopp, Rahul Ramachandran, Paolo Fraccaro, Thomas Brunschwiler, Gabriele Cavallaro, Juan Bernabe-Moreno, Nicolas Long\'ep\'e
arXiv Computer Vision
Oct 9

S$^3$Geo: Structure-Semantic Synergistic Learning for Cross-View Geo-Localization

S$^3$Geo introduces a structure‑semantic synergistic learning framework for cross‑view geo‑localization, combining a Decoupled Query Pooling module to capture local structural patterns, an optimal‑transport based contrastive learning scheme for soft cross‑view correspondences, and a Semantic Knowledge Distillation strategy from a frozen CLIP teacher to embed semantic priors. The method jointly models fine‑grained structural and semantic information, enabling robust matching between images from vastly different viewpoints such as drone and satellite views. Experiments on University‑1652 and SUES‑200 datasets show that S$^3$Geo outperforms state‑of‑the‑art approaches without increasing inference complexity.

By Ziqian Mo, Hill Zhang, Haosheng Tan, Ling Li, Jiaheng Wei
Hugging Face Trending Papers
Jun 23

Benchmarking the Alignment of Data-Quality Metrics, Human Judgment and Land-Cover Segmentation Performance for Earth Observation

Volume and quality of datasets are crucial for deep learning model training, yet they are often constrained by availability and data acquisition costs. Synthetic data augmentation can extend existing datasets with realistic images, and the quality of these images is generally assessed through fidelity metrics such as FID, KID, IS, LPIPS and SSIM that measure structural or distributional similarity.