arXiv Machine Learning

Many Pixels, One Composition: Self-Supervised Spectra for Specimen-Level Prediction

arXiv Machine Learning
Sep 1

Minerals in the Wild: A Hyperspectral-XRF Dataset for Elemental Composition Estimation

arXiv:2608.30537v1 Announce Type: cross Abstract: Rapid mineral characterization is essential for applications ranging from mineral exploration to industrial ore processing. To this end, Hyperspectra...

By Eleftheria Tetoula-Tsonga (Institute of Communication and Computer Systems, Athens, Greece), George Arvanitakis (Geonova, Athens, Greece), Theodoros Giannakas (Institute of Communication and Computer Systems, Athens, Greece)
arXiv AI
Sep 10

AGSA-Net: Abundance-Guided Self-Attention Network for Spectral Unmixing-Aware Hyperspectral Remote Sensing Image Classification

AGSA-Net is a hyperspectral image classification framework that incorporates spectral unmixing priors through an abundance-guided self‑attention network. It first estimates physically meaningful subpixel abundance maps with non‑negativity and sum‑to‑one constraints, then uses these abundances to build an affinity prior that directs a spectral transformer to focus on class‑discriminative interactions. The transformer features are fused with compact abundance descriptors for final classification, and experiments on Indian Pines, Augsburg, and Berlin datasets show improved performance, especially in heterogeneous urban scenes.

By Nafisa Anjum, Satavisa Dey Borno, Ananna Saha, Mir Faiyaz Hossain, Sifat Momen, Nabeel Mohammed, Shafin Rahman
arXiv Computer Vision
Sep 30

HyperSAM: A Promptable Foundation Model for Hyperspectral Remote Sensing

HyperSAM is a promptable foundation model for hyperspectral remote sensing that integrates a data‑centric synthesis pipeline with a spectral adaptation architecture based on Segment Anything Model 3 (SAM3). The model generates full‑spectrum hyperspectral cubes from high‑resolution multispectral imagery using a physics‑informed abundance‑transfer generator, and employs SAM3‑derived pseudo‑masks for object‑centric supervision. With a frozen SAM3 RGB branch, a trainable hyperspectral encoder, ControlNet‑style feature injection, and a mixture‑of‑experts mask refiner, HyperSAM demonstrates strong generalization across diverse hyperspectral tasks such as classification, anomaly detection, change detection, target detection, and airborne oil‑spill mapping.

By Li Pang, Xinqiao Wu, Jing Yao, Pedram Ghamisi, Jun Zhou, Zhengchao Chen, Deyu Meng, Xiangyong Cao
arXiv Computer Vision
Oct 26

Physics-Aware Self-Supervised Pretraining on Multi-Domain Raman Spectra

The paper presents a physics‑aware, multi‑domain self‑supervised learning framework for Raman spectroscopy that uses a masked autoencoder with a sparse Voigt‑profile decoder and a denoising objective. It learns transferable spectral representations from diverse biological, chemical, forensic, and materials datasets, and demonstrates improved performance on substance classification, component identification, concentration estimation, and spectral denoising. The study shows that self‑supervised pretraining is especially beneficial for tasks with limited labeled data, that attention‑based probing reveals richer information than linear probing, and that larger encoders benefit more from pretraining.

By Charalampos Davalas, Georgios Levantinos, Anastasios Dimitriou, Nikolaos Papanikolaou, Georgios Th. Papadopoulos, Dimitrios Michail
arXiv Machine Learning
Sep 1

MWIR-4-Plastic: The Identification of Complex End-of-Life Industrial Plastic using Mid-wave Infrared Hyperspectral Imaging and Machine Learning

The paper presents the first publicly available hyperspectral imaging (HSI) dataset of shredded black plastics from end‑of‑life vehicle waste, covering four industrial polymers across RGB, VNIR, SWIR, and MWIR modalities. It introduces a multi‑modal spectral‑spatial framework that combines foreground isolation, pixel‑wise classification, and object‑level majority voting, leveraging hyperspectral transformers and chemometric band selection to accurately classify complex black plastics. The study benchmarks nine processing methods—including chemometric, machine learning, and deep learning architectures—providing a reproducible, comprehensive benchmark for industrial hyperspectral object analysis.

By Elias Arbash, Andr\'ea de Lima Ribeiro, Filipa Sim\~oes, Ahmed Jamal Afifi, Aldino Rizaldy, Yuleika Madriz, Samuel Thiele, Sandra Lorenz, Margret Fuchs, Pedram Ghamisi, Paul Scheunders, Richard Gloaguen
arXiv Computer Vision
Oct 23

From Articles to Canopies: Knowledge-Driven Pseudo-Labelling for Tree Species Classification using LLM Experts

The paper introduces a biologically informed, semi‑supervised deep learning approach for hyperspectral tree species classification that fuses hyperspectral imaging and airborne laser scanning data with ecological knowledge. It uses a canopy graph and biologically inspired pseudo‑labelling, enhanced by expert priors derived from a large language model‑assisted, citation‑constrained workflow, to improve classification accuracy. Experiments on two real‑world forest datasets demonstrate macro‑F1 gains of 6.01 and 4.85 percentage points over leading classical HSI–ALS pipelines.

By Micha{\l} Romaszewski, Dominik Kope\'c, Micha{\l} Cholewa, Katarzyna Ko{\l}odziej, Przemys{\l}aw G{\l}omb, Jan Niedzielko, Jakub Charyton, Justyna Wylaz{\l}owska, Anna Jaroci\'nska
arXiv Computer Vision
Sep 15

Hyperspectral Image Restoration and Super-resolution with Physics-Aware Deep Learning for Biomedical Applications

The paper introduces a self‑supervised, physics‑aware deep learning method for hyperspectral image restoration and super‑resolution in biomedical imaging. It achieves 16× pixel super‑resolution and 12× faster imaging without external training data, preserving biological integrity across synthetic and experimental samples. The approach also reveals disease‑associated metabolic changes and offers physical insights into the model’s workings, with all code released as open source.

By Yuchen Xiang, Zhaolu Liu, Monica Emili Garcia-Segura, Daniel Simon, Boxuan Cao, Vincen Wu, Kenneth Robinson, Yu Wang, Ronan Battle, Najah Sobhan, Robert T. Murray, Xavier Altafaj, John Marshall, Luca Peruzzotti-Jametti, Zoltan Takats
arXiv AI
Aug 25

Beyond RGB: Benchmarking and Enhancing MLLMs for Hyperspectral Image Understanding via Training-Free Reasoning Framework

arXiv:2604.08884v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on RGB image understanding, yet their ability to use spectral evide...

By Xinyu Zhang, Zurong Mai, Qingmei Li, Xiaoya Fan, Zjin Liao, Haoyuan Liang, Yibin Wen, Yuhang Chen, Chan Tsz Ho, Bi Tianyuan, Ruifeng Su, Zihao Qiang, Juepeng Zheng, Jianxi Huang, Yutong Lu, Haohuan Fu
arXiv Computer Vision
Aug 31

HyperVision: A Channel-Adaptive Ground-Based Hyperspectral Vision Pre-trained Backbone

HyperVision introduces the first ground‑based hyperspectral pre‑trained backbone, addressing challenges of varying spectral configurations, limited annotations, and dataset diversity. It employs a channel‑adaptive dynamic embedding to unify heterogeneous inputs, a multi‑source pseudo‑labeling strategy combining SAM2 spatial cues with HyperFree spectral details, and cross‑modal knowledge distillation from a pre‑trained RGB vision model. Trained on 15k images from 26 datasets, HyperVision achieves significant improvements—up to 16.3% relative gain in hyperspectral semantic segmentation, 2.1% in object tracking AUC, and 35.5% reduction in salient object detection MAE—while requiring only head‑only adaptation.

By Guanyiman Fu, Jingtao Li, Zihang Cheng, Zhuanfeng Li, Diqi Chen, Yan Xu, Xiangyu Liu, Fengchao Xiong, Jianfeng Lu, Chengrong Chen, Jun Zhou