arXiv Machine Learning

Spectral-Spatial Interpretation

Spectral‑Spatial Interpretation (SSI) is a new full‑grid attribution method that assigns importance to each position‑channel pair in multispectral images. By fixing the surrounding context at each spatial location and applying Shapley values to the local channel game, SSI produces a spectral‑spatial attribution matrix rather than a single heatmap or global channel ranking. Experiments on HLS Burn Scar, CUB‑200, and EuroSAT show that SSI outperforms existing estimators in deletion/insertion metrics, achieves strong spectral hit rates, and improves spatial localization on annotated datasets.

arXiv Machine Learning
Sep 22

Graph-to-Grid (G2G): Continuous-Coordinate Feature Painting for Soccer Pass Surfaces

The paper introduces Graph-to-Grid (G2G), a method that paints continuous‑coordinate player features onto a grid using bilinear interpolation, enabling end‑to‑end training of per‑player encoders for pass surface prediction. On 53,628 World Cup passes, this painting approach improves selection likelihood by about a quarter of a nat compared to raster‑only inputs, with further gains from learned encoders and message passing. The study also shows that painting benefits existing models like SoccerMap and U‑Net, while other variants such as offset channels or raster‑free decoders do not provide similar improvements.

By Kaan G\"unay, Orhun Gun
arXiv Machine Learning
Sep 29

Do Location Encoders Capture Spatial Effects? A GeoShapley Benchmark Across Scales

Location encoders transform geographic coordinates into high‑dimensional embeddings for machine learning, yet it is unclear how well these embeddings capture interpretable spatial effects. This study benchmarks GeoShapley—a game‑theoretic explainer treating all location features as a single joint player—against eleven TorchSpatial encoders on a synthetic process with known coefficients, across grid, county, and global scales, with and without raw coordinates and under different training regimes. The results show that primary coefficient recovery is consistently high across encoders, while secondary coefficient recovery varies more with scale, especially at the global level, and raw‑coordinate baselines remain competitive throughout.

By Daniel Kiv, Shaowen Wang
arXiv Computer Vision
Aug 27

OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs

OVO‑S‑Bench is a fully human‑annotated benchmark designed to evaluate streaming spatial intelligence in multimodal large language models (MLLMs). It contains 1,680 questions derived from 348 source videos, each with a query timestamp and evidence interval, and tests models on four levels of abstraction: instantaneous egocentric perception, spatiotemporal context tracking, generative spatial reasoning, and allocentric spatial mapping. Across 38 MLLMs, Gemini‑3.1‑Pro scored 59.2 versus 92.2 for human experts, with allocentric spatial mapping identified as the main challenge, and the benchmark reveals that chain‑of‑thought reasoning can worsen spatial errors when not grounded in the stream.

By Yifei Li, Pengyiang Liu, Yuhang Zang, Zhongyue Shi, Qi Fu, Hongye Hao, Jiwen Lu
arXiv Computer Vision
Oct 26

LoCA: Enabling Multi-Modality in Geospatial Location Encoders

arXiv:2610.32894v1 Announce Type: new Abstract: Location encoders map geographic coordinates to high-dimensional descriptors through contrastive alignment with paired Earth Observation imagery. We pr...

By Panagiotis Koromilas, Eleanna Vali, Diogenis Antonopoulos, Eleni Saka, Dimitris Christofis, Nikolaos Ioannis Bountos, Konstantin Klemmer, Ioannis Papoutsis, Yannis Panagakis, Mihalis A. Nicolaou
arXiv Computer Vision
Oct 28

LESSViT: Robust Hyperspectral Representation Learning under Spectral Configuration Shift

LESSViT introduces a sensor‑flexible Vision Transformer for hyperspectral imagery that uses a low‑rank structured attention mechanism (LESS Attention) to efficiently model joint spatial‑spectral interactions. By reducing the complexity from ≠O(N^2C^2) to ≠O(rNC) and adding channel‑agnostic patch embedding with wavelength‑aware positional encoding, it supports flexible spectral inputs. A hyperspectral masked autoencoder (HyperMAE) with decoupled spatial‑spectral masking further enables robust pretraining, and experiments on the SpectralEarth benchmark show improved robustness to spectral shifts while maintaining competitive in‑distribution performance.

By Haozhe Si, Yuxuan Wan, Yuqing Wang, Minh N. Do, Han Zhao
arXiv Computation and Language
Sep 1

Mechanistic Diagnostics of Spatial Lexical Bias in Multimodal Large Language Model Spatial Reasoning

arXiv:2606.01914v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) remain unreliable on spatial multiple-choice questions, and their failures are often attributed to poorly...

By Chuang Ma, Qianying Liu, Tomoyuki Obuchi, Fei Cheng, Wang Yang, Sudong Cai, Shuyuan Zheng, Akiko Aizawa, Sadao Kurohashi
arXiv Computer Vision
Sep 2

DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting

DCA-MoE is a crowd‑counting framework that keeps a frozen DINOv3 encoder while introducing two content‑dependent modules: Spatially Adaptive Layer Fusion (SALF) assigns position‑wise weights to four backbone features, and Density‑Routed Multi‑Receptive‑Field Experts (DR‑MoE) mixes local, mid‑range, and large‑context residual experts for each location. An EBC‑style head reconstructs block density, and the model is trained with DMCount supervision plus a routing‑balance term. On the NWPU‑Crowd validation split, the best configuration based on DINOv3 ViT‑L/16 achieves 31.7 MAE and 72.2 RMSE, while the ViT‑B/16 full model records 32.2/75.9.

By Hao Wang
arXiv Machine Learning
Sep 23

MIND the Gap: A Geographic Implicit Neural Representation with Adjustable Spatial Scale

The paper introduces MIND, a method that distills specialist geospatial model embeddings into a single generalist coordinate embedding with adjustable spatial granularity, using nested supervision across multiple embedding dimensions. MIND’s design allows downstream predictors to use only leading chunks or apply a Chunked Penalty to downweight finer details without retraining the INR. The authors evaluate MIND on CoordBench, a large INR benchmark of 52 datasets and 78 targets, and report that MIND and its Chunked Penalty variant achieve the highest regression and classification scores, especially under regional holdout, establishing a new state‑of‑the‑art for geographic implicit neural representations.

By Isaac Corley, Arjun Rao, Esther Rolf, Konstantin Klemmer, Evan Shelhamer, Nils Lehmann, Marc Ru{\ss}wurm, Gengchen Mai, Nathan Jacobs, Hannah Kerner