arXiv Machine Learning By Haotian Ma, Ruqi Yang, Philip Townsend

Spectral-Spatial Interpretation

Read the original on arXiv Machine Learning →

Spectral‑Spatial Interpretation (SSI) is a new full‑grid attribution method that assigns importance to each position‑channel pair in multispectral images. By fixing the surrounding context at each spatial location and applying Shapley values to the local channel game, SSI produces a spectral‑spatial attribution matrix rather than a single heatmap or global channel ranking. Experiments on HLS Burn Scar, CUB‑200, and EuroSAT show that SSI outperforms existing estimators in deletion/insertion metrics, achieves strong spectral hit rates, and improves spatial localization on annotated datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 22

Graph-to-Grid (G2G): Continuous-Coordinate Feature Painting for Soccer Pass Surfaces

The paper introduces Graph-to-Grid (G2G), a method that paints continuous‑coordinate player features onto a grid using bilinear interpolation, enabling end‑to‑end training of per‑player encoders for pass surface prediction. On 53,628 World Cup passes, this painting approach improves selection likelihood by about a quarter of a nat compared to raster‑only inputs, with further gains from learned encoders and message passing. The study also shows that painting benefits existing models like SoccerMap and U‑Net, while other variants such as offset channels or raster‑free decoders do not provide similar improvements.

By Kaan G\"unay, Orhun Gun
arXiv Machine Learning
Sep 29

Do Location Encoders Capture Spatial Effects? A GeoShapley Benchmark Across Scales

Location encoders transform geographic coordinates into high‑dimensional embeddings for machine learning, yet it is unclear how well these embeddings capture interpretable spatial effects. This study benchmarks GeoShapley—a game‑theoretic explainer treating all location features as a single joint player—against eleven TorchSpatial encoders on a synthetic process with known coefficients, across grid, county, and global scales, with and without raw coordinates and under different training regimes. The results show that primary coefficient recovery is consistently high across encoders, while secondary coefficient recovery varies more with scale, especially at the global level, and raw‑coordinate baselines remain competitive throughout.

By Daniel Kiv, Shaowen Wang
arXiv Computer Vision
Aug 27

OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs

OVO‑S‑Bench is a fully human‑annotated benchmark designed to evaluate streaming spatial intelligence in multimodal large language models (MLLMs). It contains 1,680 questions derived from 348 source videos, each with a query timestamp and evidence interval, and tests models on four levels of abstraction: instantaneous egocentric perception, spatiotemporal context tracking, generative spatial reasoning, and allocentric spatial mapping. Across 38 MLLMs, Gemini‑3.1‑Pro scored 59.2 versus 92.2 for human experts, with allocentric spatial mapping identified as the main challenge, and the benchmark reveals that chain‑of‑thought reasoning can worsen spatial errors when not grounded in the stream.

By Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu
arXiv Computer Vision
Oct 26

LoCA: Enabling Multi-Modality in Geospatial Location Encoders

arXiv:2610.32894v1 Announce Type: new Abstract: Location encoders map geographic coordinates to high-dimensional descriptors through contrastive alignment with paired Earth Observation imagery. We pr...

By Panagiotis Koromilas, Eleanna Vali, Diogenis Antonopoulos, Eleni Saka, Dimitris Christofis, Nikolaos Ioannis Bountos, Konstantin Klemmer, Ioannis Papoutsis, Yannis Panagakis, Mihalis A. Nicolaou