GTPred is a new benchmark for geo‑temporal prediction that evaluates multi‑modal large language models (MLLMs) on 370 images taken across 120 years worldwide. It assesses predictions by matching both the year and a hierarchical location sequence, and includes annotated reasoning chains to test intermediate reasoning. Experiments on 15 MLLMs show that while visual perception is strong, models still lack world knowledge and geo‑temporal reasoning, and that adding temporal data improves location inference.
By Jinnao Li, Tingzhu Chen, Changbo Wang
arXiv:2608. 03826v1 Announce Type: cross Abstract: Geospatial and urban applications increasingly require models to compare heterogeneous evidence across street-view imagery, remote-sensing observations, text descriptions, region proposals, and temporal change cues.
By Jiapeng Li, Yong Li, Junjie Zhou, Fan Zhang, Yu Liu
arXiv:2603.08491v3 Announce Type: replace
Abstract: Cross-modal Geo-localization (CMGL) matches ground-level text descriptions with geo-tagged aerial imagery, which is crucial for pedestrian navigati...
By Yutong Hu, Jinhui Chen, Chaoqiang Xu, Yuan Kou, Sili Zhou, Shaocheng Yan, Pengcheng Shi, Qingwu Hu, Jiayuan Li
GTASA: Ground Truth Annotations for Spatiotemporal Analysis, Evaluation and Training of Video Models presents GEST-Engine, an open‑source system that deterministically renders multi‑actor video scenarios while recording exhaustive ground truth—including 3D entity and camera states, pairwise spatial relations, event‑to‑frame mappings, instance segmentation, and long descriptions—at no extra annotation cost. The authors release a 938‑video dataset, GTASA, which offers the densest spatial‑relation coverage of any video dataset, with an entity‑pair relation graph at every frame that is roughly 84× denser than current state‑of‑the‑art collections. They demonstrate the dataset’s value by showing that pretraining on GTASA improves VideoLLaMA3 captioning, and by using it to probe frozen video encoders on 11 spatio‑temporal tasks, revealing that relational understanding remains near chance.
whyItMatters":"The dataset provides a uniquely dense, exact 3D ground truth for spatio‑temporal video analysis, enabling measurable progress in training and evaluating video models on relational reasoning tasks."
By Nicolae Cudlenco, Mihai Masala, Marius Leordeanu
arXiv:2606.08918v2 Announce Type: replace
Abstract: Worldwide image geo-localization aims to determine where on Earth a single image was captured. However, visually similar scenes may lie thousands o...
By Junchao Cui, Xuanzi Ma, Wenqi Shi, Nan Wu, Biru Zhu, Xiangyang Luo
Geospatial and urban applications increasingly require models to compare heterogeneous evidence across street-view imagery, remote-sensing observations, text descriptions, region proposals, and temporal change cues. However, existing multimodal embedding models and benchmarks are still largely designed and evaluated around general-purpose image-text matching, leaving unclear whether unified embedding space can support heterogeneous geospatial tasks involving spatial relationships, fine-grained semantics, and temporal changes.
arXiv:2610.26925v1 Announce Type: new
Abstract: With the rapid expansion of online video content, video temporal grounding has become essential for localizing moments based on user-specific queries,...
By Sanghyeok Lee, Juyeon Ko, Joonmyung Choi, Jongha Kim, Dohwan Ko, Ji Soo Lee, Hyunwoo J. Kim
arXiv:2505.07622v2 Announce Type: replace
Abstract: Cross-view geo-localization is a promising solution for large-scale localization problems, requiring the sequential execution of retrieval and metr...
By Zhuo Song, Ye Zhang, Kunhong Li, Longguang Wang, Yulan Guo
arXiv:2610.07925v1 Announce Type: new
Abstract: Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos containing moments relevant to a given text query. Despite recent progress,...
By Giyeol Kim, Chanho Eom
The paper introduces Intrinsic Temporal Adaptation (ITA) for Partially Relevant Video Retrieval (PRVR), a task that seeks untrimmed videos containing moments relevant to a text query. ITA employs a Backbone-Internal Temporal Adaptation that lets the final visual transformer layers attend to neighboring frames, creating temporally aware embeddings while keeping CLIP frozen. Additionally, an Affinity-Weighted Gradient Propagation technique softly aggregates top‑k frames based on text‑frame affinities to better handle the weakly supervised nature of PRVR, leading to state‑of‑the‑art performance and more accurate frame‑level evidence retrieval.
By Hyun Seok Seong, Woojin Jun, SuBeen Lee, Jae-Pil Heo
arXiv:2505.12254v3 Announce Type: replace-cross
Abstract: Existing visual place recognition (VPR) datasets predominantly rely on vehicle-mounted imagery, offer limited multimodal diversity, and under...
By Yiwei Ou, Xiaobin Ren, Ronggui Sun, Guansong Gao, Kaiqi Zhao, Manfredo Manfredini
The paper introduces query‑guided grounding methods for video understanding, covering object‑level, relationship‑level, and moment‑level tasks. For object grounding, QDETRv and TOViT enable one‑shot and few‑shot localization of unseen objects using query‑context fusion, memory modules, and language‑aligned vision encoders. Relationship grounding is addressed with a few‑shot referring framework that optimizes a T‑partite random field, while moment grounding is tackled by the Moment Alignment Transformer (MATR), which employs dynamic time warping and self‑supervised pretraining for video‑to‑video and text‑to‑video retrieval.
By Yogesh Kumar