arXiv Computer Vision
Aug 27

GTPred: Benchmarking MLLMs for Interpretable Geo-localization and Time-of-capture Prediction

GTPred is a new benchmark for geo‑temporal prediction that evaluates multi‑modal large language models (MLLMs) on 370 images taken across 120 years worldwide. It assesses predictions by matching both the year and a hierarchical location sequence, and includes annotated reasoning chains to test intermediate reasoning. Experiments on 15 MLLMs show that while visual perception is strong, models still lack world knowledge and geo‑temporal reasoning, and that adding temporal data improves location inference.

By Jinnao Li, Tingzhu Chen, Changbo Wang
arXiv AI
Oct 12

Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing

The paper introduces GeoSpatialBench, a benchmark for evaluating spatial reasoning and constrained spatial editing in multimodal large language models. It tests 28 spatial relations across GeoJSON and map image data from six cities, revealing that models perform better on GeoJSON than images and struggle with quantitative metric relations and editing tasks that must satisfy spatial constraints. The study highlights a significant gap between recognizing spatial relations and actively manipulating them in AI systems.

By Zheng Ren, Yanning Wang, Ziheng Huang, Fei Huang, Shiqi Wang, Ziqian Ye, Yang Yue