arXiv Machine Learning

A Variational Latent-Space Framework for Uncertainty-Aware Spectral Image Emulation

arXiv Computer Vision
Sep 7

HyVIC: A Metric-Driven Spatio-Spectral Hyperspectral Image Compression Architecture Based on Variational Autoencoders

HyVIC is a configurable variational autoencoder designed for hyperspectral image compression that explicitly separates spatial and spectral feature learning. By allowing independent control of these two aspects, the architecture improves reconstruction fidelity across a wide range of compression ratios, achieving up to 4.66 dB better BD‑PSNR than previous methods. The authors also introduce a metric‑driven strategy for hyperparameter selection and provide code and pretrained models publicly.

By Martin Hermann Paul Fuchs, Behnood Rasti, Beg\"um Demir
arXiv Computer Vision
Oct 1

Hyperspectral Image Models: Technical Report

The technical report introduces Hyperspectral Image Models, a modular framework that unifies 55 deep‑learning models across six paradigms for hyperspectral remote sensing. It standardizes tensor conventions, evaluation protocols, and dataset handling, integrating 24 benchmark scenes from various sensors and providing tools to avoid train‑test overlap. Experiments across 1,320 model‑scene combinations show that scene difficulty outweighs architecture, with no single paradigm dominating and small models achieving performance comparable to much larger ones.

By Tanishq Rachamalla, Aryan Das, Srishti Kaushik, Swalpa Kumar Roy
arXiv Computer Vision
Sep 30

HyperSAM: A Promptable Foundation Model for Hyperspectral Remote Sensing

HyperSAM is a promptable foundation model for hyperspectral remote sensing that integrates a data‑centric synthesis pipeline with a spectral adaptation architecture based on Segment Anything Model 3 (SAM3). The model generates full‑spectrum hyperspectral cubes from high‑resolution multispectral imagery using a physics‑informed abundance‑transfer generator, and employs SAM3‑derived pseudo‑masks for object‑centric supervision. With a frozen SAM3 RGB branch, a trainable hyperspectral encoder, ControlNet‑style feature injection, and a mixture‑of‑experts mask refiner, HyperSAM demonstrates strong generalization across diverse hyperspectral tasks such as classification, anomaly detection, change detection, target detection, and airborne oil‑spill mapping.

By Li Pang, Xinqiao Wu, Jing Yao, Pedram Ghamisi, Jun Zhou, Zhengchao Chen, Deyu Meng, Xiangyong Cao
arXiv Computer Vision
Oct 5

A PyTorch Library for Hyperspectral Image Models: Technical Report

The paper introduces a PyTorch library that unifies 55 hyperspectral image models across six deep‑learning paradigms, providing a common registry, automatic tensor adaptation, and standardized constructors. It includes 24 benchmark scenes from various sensors, with tools for data preprocessing, patch extraction, and rigorous train‑test partitioning to avoid overlap. Experiments on 1,320 model‑scene combinations show that scene difficulty outweighs architecture choice, with no single paradigm dominating and small models performing competitively with much larger ones.

By Tanishq Rachamalla, Aryan Das, Srishti Kaushik, Swalpa Kumar Roy
arXiv AI
Aug 25

Beyond RGB: Benchmarking and Enhancing MLLMs for Hyperspectral Image Understanding via Training-Free Reasoning Framework

arXiv:2604.08884v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on RGB image understanding, yet their ability to use spectral evide...

By Xinyu Zhang, Zurong Mai, Qingmei Li, Xiaoya Fan, Zjin Liao, Haoyuan Liang, Yibin Wen, Yuhang Chen, Chan Tsz Ho, Bi Tianyuan, Ruifeng Su, Zihao Qiang, Juepeng Zheng, Jianxi Huang, Yutong Lu, Haohuan Fu
arXiv Computer Vision
Aug 31

HyperVision: A Channel-Adaptive Ground-Based Hyperspectral Vision Pre-trained Backbone

HyperVision introduces the first ground‑based hyperspectral pre‑trained backbone, addressing challenges of varying spectral configurations, limited annotations, and dataset diversity. It employs a channel‑adaptive dynamic embedding to unify heterogeneous inputs, a multi‑source pseudo‑labeling strategy combining SAM2 spatial cues with HyperFree spectral details, and cross‑modal knowledge distillation from a pre‑trained RGB vision model. Trained on 15k images from 26 datasets, HyperVision achieves significant improvements—up to 16.3% relative gain in hyperspectral semantic segmentation, 2.1% in object tracking AUC, and 35.5% reduction in salient object detection MAE—while requiring only head‑only adaptation.

By Guanyiman Fu, Jingtao Li, Zihang Cheng, Zhuanfeng Li, Diqi Chen, Yan Xu, Xiangyu Liu, Fengchao Xiong, Jianfeng Lu, Chengrong Chen, Jun Zhou
arXiv Computer Vision
Sep 2

Agentic Multimodal Models for Environmental Hyperspectral Unmixing

The paper presents an agentic framework that uses a large vision‑language model to refine hyperspectral unmixing results from existing modular pipelines. By iteratively gathering spectral and spatial evidence through tools such as spectral‑library retrieval and abundance‑map visualization, the agent merges or discards endmembers and re‑estimates abundances. Experiments on HYDICE Urban, Jasper Ridge, and Stonewall Playa datasets show consistent improvements in endmember cardinality and overall decomposition quality across multiple pipelines, while remaining competitive with end‑to‑end methods.

By Micha{\l} Cholewa, Luca Ciampi, Nicola Messina, Przemys{\l}aw G{\l}omb, Giuseppe Amato