Benchmarking deep learning (DL) models for multi-label classification (MLC) of remote sensing images (RSI) typically yields rankings that do not generalize beyond the evaluated datasets. In this work, we move beyond rankings by employing functional analysis of variance (fANOVA) to systematically quantify the contributions of individual design choices and their interactions to performance variability.
arXiv:2608.23182v1 Announce Type: cross
Abstract: We present a comparative study of label-free metrics for assessing the quality of representations in deep neural networks to understand their reliabi...
By Daniel Richards Arputharaj, Daniel J\"onsson, Gabriel Eilertsen
arXiv:2608. 00135v1 Announce Type: new Abstract: Design and architectural archives encode expert human knowledge in graphical formats, providing a critical testbed for design-inspired Machine Learning (ML) challenges absent with typical computer vision benchmarks.
By Alexandros Haridis, Charles Zhou
arXiv:2602.01718v2 Announce Type: replace
Abstract: Predicting generalization from quantities available before target-test evaluation remains a central challenge in deep learning. The systematic benc...
By Sora Nakai, Youssef Fadhloun, Kacem Mathlouthi, Kotaro Yoshida, Ganesh Talluri, Ioannis Mitliagkas, Hiroki Naganuma
Vision-Language Models (VLMs) such as CLIP are now foundational to multimodal systems, yet their robustness to spurious correlations remains poorly understood at scale. We present the first large-scale empirical study of 194 publicly available VLMs, including 16 model families, covering a wide range of model sizes, 24 training datasets, and three evaluation benchmarks, namely ImageNet (overall performance), CelebA (typical single-attribute bias), and UrbanCars (complex multi-attribute biases).
arXiv:2607. 23024v1 Announce Type: cross Abstract: High-resolution satellite imagery is the backbone of good land-cover classification, and without that, environmental monitoring, urban planning, and sustainable resource management all fall short.
By Atiq Ur Rehman, Joseph Michael Donovan
arXiv:2512. 22702v2 Announce Type: replace Abstract: Deep learning models have grown popular in time series applications.
By Valentina Moretti, Ivan Marisca, Cesare Alippi, Andrea Cini
The paper investigates how evaluation protocols and ground‑truth quality affect the classification performance of Multimodal Large Language Models (MLLMs). It identifies and corrects key issues such as discarded out‑of‑list outputs, inflated distractor choices, and poor open‑world mapping, and shows that design choices like batch size, image ordering, and text encoder selection significantly influence accuracy. Using a multilabel reannotation of 625 ImageNet‑1k classes (ReGT), the study finds that corrected labels can boost MLLM performance by up to 10.8%, narrowing the gap with supervised models, and demonstrates that MLLMs can assist human annotators in about half of difficult cases.
By Nikita Kisel, Illia Volkov, Klara Janouskova, Jiri Matas
arXiv:2607. 11541v1 Announce Type: new Abstract: We introduce a straightforward yet effective method to empirically study memorization in deep neural networks for classification tasks.
By Marlon Becker, Jonas Konrad, Luis Garcia Rodriguez, Benjamin Risse
arXiv:2606. 13896v1 Announce Type: cross Abstract: Self-supervised geospatial foundation models (GeoFMs) learn transferable representations from remote sensing data, but their downstream behavior is difficult to characterize.
By Julia Romero, Qin Lv, Morteza Karimzadeh
arXiv:2609.37481v1 Announce Type: new
Abstract: Large-scale pervasive sensing increasingly relies on high-resolution satellite imagery, yet task-specific onboard vision is constrained by costly annot...
By Ahmed Abdelnaby, Mohamed Elmahallawy, Marius Bernahrndt, Tobias Hecking
arXiv:2609.38603v1 Announce Type: new
Abstract: While earth observation models have advanced substantially, they still lack interpretability. While concept-bottleneck models provide interpretability...
By Rishabh Mondal, Nipun Batra, Utkarsh Mall