arXiv Computer Vision
Benchmarking Hyperspectral Foundation Models for Hyperspectral Unmixing
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Sep 3
Ten Architectures, One Error: Shared Failure Modes in Hyperspectral Classification under Spatially Disjoint Evaluation
The paper critiques the common practice of random pixel splits in hyperspectral image classification, noting that such splits allow test pixels to be adjacent to training pixels, inflating accuracy. It proposes a leakage‑free evaluation protocol that enforces spatial separation based on the model’s receptive field and applies it to ten diverse architectures, finding a significant drop in Macro‑F1 (average 0.147) and substantial changes in model rankings. The study also shows that all ten models misclassify the same pixels, indicating a spectral ambiguity in the data that current methods cannot resolve.
Hugging Face Trending Papers
1d ago
Hyperspectral Image Models: Technical Report
Hyperspectral remote sensing has advanced across diverse deep learning paradigms, including spectral spatial CNNs, Vision Transformers, Mamba, graph neural networks, Kolmogorov Arnold networks, and se...
arXiv Computer Vision
1d ago
Hyperspectral Image Models: Technical Report
The technical report introduces Hyperspectral Image Models, a modular framework that unifies 55 deep‑learning models across six paradigms for hyperspectral remote sensing. It standardizes tensor conventions, evaluation protocols, and dataset handling, integrating 24 benchmark scenes from various sensors and providing tools to avoid train‑test overlap. Experiments across 1,320 model‑scene combinations show that scene difficulty outweighs architecture, with no single paradigm dominating and small models achieving performance comparable to much larger ones.
arXiv Computer Vision
1d ago
Hyperspectral Image Dataset for Benchmarking on Salient Object Detection
The paper introduces a new hyperspectral image dataset for benchmarking salient object detection, comprising 60 hyperspectral images, their ground‑truth binary masks, and corresponding sRGB renderings. The dataset was curated to include diverse object sizes, counts, contrasts, and positions, addressing the lack of dedicated hyperspectral data for this task. The authors also evaluate existing hyperspectral saliency models using the AUC metric and provide the dataset on GitHub and Hugging Face.
arXiv Computer Vision
Sep 21
MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition
The paper introduces MultiHU‑TD, an interpretable framework for multifeature hyperspectral unmixing that employs tensor decomposition and incorporates the abundance sum‑to‑one constraint via an ADMM algorithm. It extends previous models by adding mathematical morphology and neighborhood patch analysis, and provides detailed mathematical, physical, and graphical interpretations linked to the extended linear mixing model. Experiments on real hyperspectral images demonstrate the model’s interpretability and effectiveness, with code released on GitHub.
arXiv Computer Vision
2d ago
HyperSAM: A Promptable Foundation Model for Hyperspectral Remote Sensing
HyperSAM is a promptable foundation model for hyperspectral remote sensing that integrates a data‑centric synthesis pipeline with a spectral adaptation architecture based on Segment Anything Model 3 (SAM3). The model generates full‑spectrum hyperspectral cubes from high‑resolution multispectral imagery using a physics‑informed abundance‑transfer generator, and employs SAM3‑derived pseudo‑masks for object‑centric supervision. With a frozen SAM3 RGB branch, a trainable hyperspectral encoder, ControlNet‑style feature injection, and a mixture‑of‑experts mask refiner, HyperSAM demonstrates strong generalization across diverse hyperspectral tasks such as classification, anomaly detection, change detection, target detection, and airborne oil‑spill mapping.