arXiv Computer Vision

Hyperspectral Unmixing using a Structured Linear Mixing Model with Additive Spectral Variability

arXiv Computer Vision
Sep 21

MultiHU-TD: Multifeature Hyperspectral Unmixing Based on Tensor Decomposition

The paper introduces MultiHU‑TD, an interpretable framework for multifeature hyperspectral unmixing that employs tensor decomposition and incorporates the abundance sum‑to‑one constraint via an ADMM algorithm. It extends previous models by adding mathematical morphology and neighborhood patch analysis, and provides detailed mathematical, physical, and graphical interpretations linked to the extended linear mixing model. Experiments on real hyperspectral images demonstrate the model’s interpretability and effectiveness, with code released on GitHub.

By Mohamad Jouni, Mauro Dalla Mura, Lucas Drumetz, Pierre Comon
arXiv Computer Vision
Sep 2

Agentic Multimodal Models for Environmental Hyperspectral Unmixing

The paper presents an agentic framework that uses a large vision‑language model to refine hyperspectral unmixing results from existing modular pipelines. By iteratively gathering spectral and spatial evidence through tools such as spectral‑library retrieval and abundance‑map visualization, the agent merges or discards endmembers and re‑estimates abundances. Experiments on HYDICE Urban, Jasper Ridge, and Stonewall Playa datasets show consistent improvements in endmember cardinality and overall decomposition quality across multiple pipelines, while remaining competitive with end‑to‑end methods.

By Micha{\l} Cholewa, Luca Ciampi, Nicola Messina, Przemys{\l}aw G{\l}omb, Giuseppe Amato
arXiv Computer Vision
Sep 30

HyperSAM: A Promptable Foundation Model for Hyperspectral Remote Sensing

HyperSAM is a promptable foundation model for hyperspectral remote sensing that integrates a data‑centric synthesis pipeline with a spectral adaptation architecture based on Segment Anything Model 3 (SAM3). The model generates full‑spectrum hyperspectral cubes from high‑resolution multispectral imagery using a physics‑informed abundance‑transfer generator, and employs SAM3‑derived pseudo‑masks for object‑centric supervision. With a frozen SAM3 RGB branch, a trainable hyperspectral encoder, ControlNet‑style feature injection, and a mixture‑of‑experts mask refiner, HyperSAM demonstrates strong generalization across diverse hyperspectral tasks such as classification, anomaly detection, change detection, target detection, and airborne oil‑spill mapping.

By Li Pang, Xinqiao Wu, Jing Yao, Pedram Ghamisi, Jun Zhou, Zhengchao Chen, Deyu Meng, Xiangyong Cao
arXiv AI
Sep 10

AGSA-Net: Abundance-Guided Self-Attention Network for Spectral Unmixing-Aware Hyperspectral Remote Sensing Image Classification

AGSA-Net is a hyperspectral image classification framework that incorporates spectral unmixing priors through an abundance-guided self‑attention network. It first estimates physically meaningful subpixel abundance maps with non‑negativity and sum‑to‑one constraints, then uses these abundances to build an affinity prior that directs a spectral transformer to focus on class‑discriminative interactions. The transformer features are fused with compact abundance descriptors for final classification, and experiments on Indian Pines, Augsburg, and Berlin datasets show improved performance, especially in heterogeneous urban scenes.

By Nafisa Anjum, Satavisa Dey Borno, Ananna Saha, Mir Faiyaz Hossain, Sifat Momen, Nabeel Mohammed, Shafin Rahman
arXiv Computer Vision
Oct 21

MBTI: A Multi-Branch Efficient Fine-Tuning Framework for Hyperspectral Image Classification with Foundation Models

arXiv:2607.12782v2 Announce Type: replace Abstract: Hyperspectral foundation models learn transferable spectral-spatial representations from large-scale unlabeled data. They provide an effective para...

By Mingzhen Xu, Haonan Guo, Di Wang, Yinghua Qu, Zhiliang Zhou, Lei Zhang, Huiwen Yao, Rui Zhao, Fengxiang Wang, Gang Wan, Bo Du, Liangpei Zhang
arXiv Computer Vision
Oct 28

LESSViT: Robust Hyperspectral Representation Learning under Spectral Configuration Shift

LESSViT introduces a sensor‑flexible Vision Transformer for hyperspectral imagery that uses a low‑rank structured attention mechanism (LESS Attention) to efficiently model joint spatial‑spectral interactions. By reducing the complexity from ≠O(N^2C^2) to ≠O(rNC) and adding channel‑agnostic patch embedding with wavelength‑aware positional encoding, it supports flexible spectral inputs. A hyperspectral masked autoencoder (HyperMAE) with decoupled spatial‑spectral masking further enables robust pretraining, and experiments on the SpectralEarth benchmark show improved robustness to spectral shifts while maintaining competitive in‑distribution performance.

By Haozhe Si, Yuxuan Wan, Yuqing Wang, Minh N. Do, Han Zhao