arXiv AI

SpectralTrain: A Universal Framework for Hyperspectral Image Classification

arXiv Computer Vision
Oct 1

Hyperspectral Image Models: Technical Report

The technical report introduces Hyperspectral Image Models, a modular framework that unifies 55 deep‑learning models across six paradigms for hyperspectral remote sensing. It standardizes tensor conventions, evaluation protocols, and dataset handling, integrating 24 benchmark scenes from various sensors and providing tools to avoid train‑test overlap. Experiments across 1,320 model‑scene combinations show that scene difficulty outweighs architecture, with no single paradigm dominating and small models achieving performance comparable to much larger ones.

By Tanishq Rachamalla, Aryan Das, Srishti Kaushik, Swalpa Kumar Roy
arXiv Computer Vision
4d ago

MBTI: A Multi-Branch Efficient Fine-Tuning Framework for Hyperspectral Image Classification with Foundation Models

arXiv:2607.12782v2 Announce Type: replace Abstract: Hyperspectral foundation models learn transferable spectral-spatial representations from large-scale unlabeled data. They provide an effective para...

By Mingzhen Xu, Haonan Guo, Di Wang, Yinghua Qu, Zhiliang Zhou, Lei Zhang, Huiwen Yao, Rui Zhao, Fengxiang Wang, Gang Wan, Bo Du, Liangpei Zhang
arXiv Computer Vision
Oct 5

A PyTorch Library for Hyperspectral Image Models: Technical Report

The paper introduces a PyTorch library that unifies 55 hyperspectral image models across six deep‑learning paradigms, providing a common registry, automatic tensor adaptation, and standardized constructors. It includes 24 benchmark scenes from various sensors, with tools for data preprocessing, patch extraction, and rigorous train‑test partitioning to avoid overlap. Experiments on 1,320 model‑scene combinations show that scene difficulty outweighs architecture choice, with no single paradigm dominating and small models performing competitively with much larger ones.

By Tanishq Rachamalla, Aryan Das, Srishti Kaushik, Swalpa Kumar Roy
arXiv Computer Vision
Aug 31

HyperVision: A Channel-Adaptive Ground-Based Hyperspectral Vision Pre-trained Backbone

HyperVision introduces the first ground‑based hyperspectral pre‑trained backbone, addressing challenges of varying spectral configurations, limited annotations, and dataset diversity. It employs a channel‑adaptive dynamic embedding to unify heterogeneous inputs, a multi‑source pseudo‑labeling strategy combining SAM2 spatial cues with HyperFree spectral details, and cross‑modal knowledge distillation from a pre‑trained RGB vision model. Trained on 15k images from 26 datasets, HyperVision achieves significant improvements—up to 16.3% relative gain in hyperspectral semantic segmentation, 2.1% in object tracking AUC, and 35.5% reduction in salient object detection MAE—while requiring only head‑only adaptation.

By Guanyiman Fu, Jingtao Li, Zihang Cheng, Zhuanfeng Li, Diqi Chen, Yan Xu, Xiangyu Liu, Fengchao Xiong, Jianfeng Lu, Chengrong Chen, Jun Zhou
arXiv Computer Vision
Sep 30

HyperSAM: A Promptable Foundation Model for Hyperspectral Remote Sensing

HyperSAM is a promptable foundation model for hyperspectral remote sensing that integrates a data‑centric synthesis pipeline with a spectral adaptation architecture based on Segment Anything Model 3 (SAM3). The model generates full‑spectrum hyperspectral cubes from high‑resolution multispectral imagery using a physics‑informed abundance‑transfer generator, and employs SAM3‑derived pseudo‑masks for object‑centric supervision. With a frozen SAM3 RGB branch, a trainable hyperspectral encoder, ControlNet‑style feature injection, and a mixture‑of‑experts mask refiner, HyperSAM demonstrates strong generalization across diverse hyperspectral tasks such as classification, anomaly detection, change detection, target detection, and airborne oil‑spill mapping.

By Li Pang, Xinqiao Wu, Jing Yao, Pedram Ghamisi, Jun Zhou, Zhengchao Chen, Deyu Meng, Xiangyong Cao
arXiv Computer Vision
2d ago

From Articles to Canopies: Knowledge-Driven Pseudo-Labelling for Tree Species Classification using LLM Experts

The paper introduces a biologically informed, semi‑supervised deep learning approach for hyperspectral tree species classification that fuses hyperspectral imaging and airborne laser scanning data with ecological knowledge. It uses a canopy graph and biologically inspired pseudo‑labelling, enhanced by expert priors derived from a large language model‑assisted, citation‑constrained workflow, to improve classification accuracy. Experiments on two real‑world forest datasets demonstrate macro‑F1 gains of 6.01 and 4.85 percentage points over leading classical HSI–ALS pipelines.

By Micha{\l} Romaszewski, Dominik Kope\'c, Micha{\l} Cholewa, Katarzyna Ko{\l}odziej, Przemys{\l}aw G{\l}omb, Jan Niedzielko, Jakub Charyton, Justyna Wylaz{\l}owska, Anna Jaroci\'nska
arXiv AI
Sep 10

AGSA-Net: Abundance-Guided Self-Attention Network for Spectral Unmixing-Aware Hyperspectral Remote Sensing Image Classification

AGSA-Net is a hyperspectral image classification framework that incorporates spectral unmixing priors through an abundance-guided self‑attention network. It first estimates physically meaningful subpixel abundance maps with non‑negativity and sum‑to‑one constraints, then uses these abundances to build an affinity prior that directs a spectral transformer to focus on class‑discriminative interactions. The transformer features are fused with compact abundance descriptors for final classification, and experiments on Indian Pines, Augsburg, and Berlin datasets show improved performance, especially in heterogeneous urban scenes.

By Nafisa Anjum, Satavisa Dey Borno, Ananna Saha, Mir Faiyaz Hossain, Sifat Momen, Nabeel Mohammed, Shafin Rahman
arXiv Machine Learning
Jul 28

Machine Learning for Cloud Detection in IASI Measurements: A Data-Driven SVM Approach with Physical Constraints

arXiv:2508. 10120v2 Announce Type: replace-cross Abstract: Cloud detection is fundamental for the interpretation and operational exploitation of hyperspectral infrared sounders, yet the capability of infrared radiances alone to provide reliable cloud information remains insufficiently assessed.

By Chiara Zugarini, Cristina Sgattoni, Luca Sgheri
arXiv Machine Learning
Aug 18

Convolution-Free Holistic Multivariance Decomposition Layer for Efficient Hyperspectral Image Classification Tensor Networks

arXiv:2608. 16241v1 Announce Type: cross Abstract: Feature extraction for hyperspectral image classification is conventionally addressed using rigid tensor decompositions that fail to capture complex spatio-spectral interdependencies, or heavily parameterized convolutional neural networks that are computationally expensive.

By S\"uha Tuna, \"Ulker Ba\c{s}ar