arXiv Computer Vision

Recoverable Geographic Location Information in Earth-Observation Embeddings

The study evaluates whether Earth‑observation foundation models encode geographic location information by attempting to predict coordinates from their embeddings. Using 284 verified European solar farms, the authors tested Tessera v1, Tessera v1.1, and AlphaEarth, finding that all three models contain recoverable geographic data. AlphaEarth showed the strongest correlation between embedding distance and geographic distance, while both Tessera variants outperformed Sentinel‑2 controls, suggesting that geographic information should be considered when auditing such models.

arXiv Machine Learning
3d ago

Do Location Encoders Capture Spatial Effects? A GeoShapley Benchmark Across Scales

Location encoders transform geographic coordinates into high‑dimensional embeddings for machine learning, yet it is unclear how well these embeddings capture interpretable spatial effects. This study benchmarks GeoShapley—a game‑theoretic explainer treating all location features as a single joint player—against eleven TorchSpatial encoders on a synthetic process with known coefficients, across grid, county, and global scales, with and without raw coordinates and under different training regimes. The results show that primary coefficient recovery is consistently high across encoders, while secondary coefficient recovery varies more with scale, especially at the global level, and raw‑coordinate baselines remain competitive throughout.

By Daniel Kiv, Shaowen Wang
arXiv Computer Vision
Aug 28

Temporal Sensitivity Analysis of Tessera Embeddings

The study evaluates how the length of observation windows affects the performance of Tessera embeddings for land‑use/land‑cover mapping. By freezing the encoder and recomputing embeddings from a full year down to a single day, the authors benchmark linear probes and UNet heads on LUCAS, DynamicEarthNet, and PASTIS‑R datasets. Results show that embeddings are highly task‑dependent: for phenology‑driven classes (PASTIS‑R) they outperform from‑scratch models by ~46%, while for temporally stable classes (DynamicEarthNet, LUCAS) they match only with full supervision, yet remain more label‑efficient across all datasets.

By Julia Guerrero-Viu, Alex L\'opez-Cifuentes, Ignacio P\'erez-Villar, Fabio Pacifici
arXiv Machine Learning
Jun 19

Exploring the potential of AlphaEarth and TESSERA embeddings for Fine-scale Local Climate Zone Mapping: A case study across five cities in Switzerland

arXiv:2606. 20034v1 Announce Type: new Abstract: Understanding urban spatial morphology is critical for climate modeling, risk assessment, and sustainable urban design, and Local Climate Zone (LCZ) mapping provides the basic framework for this.

By Htet Yamin Ko Ko, Clement Atzberger
arXiv AI
Sep 10

GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims

GeoContext is a new vision‑language geolocation benchmark that introduces two tasks: GeoHint, where a model must localize an image given a coarse location hint, and GeoVerify, where a model must decide if an image was taken within 150 m of a claimed place. The benchmark builds a context ladder by stratifying nearby reference points by distance and referenceability, allowing the same image to be evaluated under varying context. Evaluation of five models on 109 sites in 30 cities shows that hint repetition is low, localization error grows with hint distance, and models struggle to achieve high discriminability in GeoVerify, with many false acceptances reported with high confidence.

By Yifan Zhang, Kai Wang
arXiv Machine Learning
Sep 23

MIND the Gap: A Geographic Implicit Neural Representation with Adjustable Spatial Scale

The paper introduces MIND, a method that distills specialist geospatial model embeddings into a single generalist coordinate embedding with adjustable spatial granularity, using nested supervision across multiple embedding dimensions. MIND’s design allows downstream predictors to use only leading chunks or apply a Chunked Penalty to downweight finer details without retraining the INR. The authors evaluate MIND on CoordBench, a large INR benchmark of 52 datasets and 78 targets, and report that MIND and its Chunked Penalty variant achieve the highest regression and classification scores, especially under regional holdout, establishing a new state‑of‑the‑art for geographic implicit neural representations.

By Isaac Corley, Arjun Rao, Esther Rolf, Konstantin Klemmer, Evan Shelhamer, Nils Lehmann, Marc Ru{\ss}wurm, Gengchen Mai, Nathan Jacobs, Hannah Kerner
arXiv Computer Vision
Aug 27

GTPred: Benchmarking MLLMs for Interpretable Geo-localization and Time-of-capture Prediction

GTPred is a new benchmark for geo‑temporal prediction that evaluates multi‑modal large language models (MLLMs) on 370 images taken across 120 years worldwide. It assesses predictions by matching both the year and a hierarchical location sequence, and includes annotated reasoning chains to test intermediate reasoning. Experiments on 15 MLLMs show that while visual perception is strong, models still lack world knowledge and geo‑temporal reasoning, and that adding temporal data improves location inference.

By Jinnao Li, Tingzhu Chen, Changbo Wang