arXiv:2511. 13020v2 Announce Type: replace-cross Abstract: Although hyperspectral imaging offers unparalleled non-invasive physiological insight, its bulky hardware, slow acquisition, and regulatory burden severely limit its clinical availability.
arXiv:2609.01060v1 Announce Type: cross Abstract: Compact snapshot hyperspectral cameras provide rich instantaneous spectral measurements for ground-level machine vision, but at lower spatial resolut...
The paper introduces TSR-ITNR, a two‑stage, self‑supervised framework for hyperspectral image super‑resolution that fuses high‑resolution multispectral and low‑resolution hyperspectral data. Stage 1 refines an implicit Tucker representation using a low‑rank spatial tensor and spectral basis, enhanced by a pretrained denoiser, to capture fine spatial details and spectral correlations. Stage 2 applies parameter‑free calibration to extract complementary corrections from both observations, preserving geometry and ensuring orthogonal complementarity, leading to superior reconstruction quality demonstrated on benchmark datasets and improved downstream segmentation performance.
HyVIC is a configurable variational autoencoder designed for hyperspectral image compression that explicitly separates spatial and spectral feature learning. By allowing independent control of these two aspects, the architecture improves reconstruction fidelity across a wide range of compression ratios, achieving up to 4.66 dB better BD‑PSNR than previous methods. The authors also introduce a metric‑driven strategy for hyperparameter selection and provide code and pretrained models publicly.
arXiv:2505.08123v2 Announce Type: replace-cross Abstract: Multi-material decomposition (MMD) enables quantitative reconstruction of tissue compositions in the human body, supporting a wide range of c...
The paper introduces two lightweight spectral adapters—Directional Spectral Adapter (DiSECT) and Spectral Instance-Guided Adapter (SiGA)—to adapt the Segment Anything Model (SAM) for accurate segmentation of colorectal liver metastases in contrast‑enhanced CT scans. SiGA achieves the highest single‑point Dice score of 0.77 and performs comparably to a 3D nnU‑Net baseline under no‑prompt inference, while DiSECT requires only 0.14 million trainable parameters. The study evaluates the adapters on 446 CT volumes across various prompting regimes, demonstrating that spectral adapters can efficiently adapt SAM with limited trainable parameters while maintaining strong segmentation accuracy.
FoCal is a new frequency‑oriented framework for aerial RGB–IR object detection that explicitly models cross‑modal interaction across different frequency components. It introduces a Frequency‑Aware Dual‑Domain Calibration module to consolidate low‑frequency structural cues while preserving high‑frequency modality‑specific details, and a Discrepancy‑Guided Spectral Modulation module that adaptively enhances, preserves, or attenuates the joint spectrum based on confidence‑weighted amplitude discrepancies. Experiments on DroneVehicle, ESCVehicle, and ATR‑UMOD show FoCal achieving high mAP scores (83.5%, 54.8%, 64.6%) with only 3.0 M parameters and 113.6 FPS, demonstrating a strong accuracy–efficiency trade‑off.
MM‑Spectrum is a sparse Mixture‑of‑Experts framework designed to infer molecular structures from multimodal spectroscopic data. It introduces a modality‑aware routing mechanism that exposes spectral identity to the router, along with shared and interaction experts of heterogeneous capacities to capture both modality‑unique and cross‑modal synergistic information while reducing noise interference. Experiments across full‑modality, bimodal, and missing‑modality scenarios show consistent and substantial performance gains, supported by ablation studies and interpretability analyses.
arXiv:2606. 04613v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) struggle when applied to medical image-text data, yet the tools available to diagnose this failure remain limited.
arXiv:2608.31159v1 Announce Type: new Abstract: The bidirectional reflectance factor (BRF) characterizes the directional radiative properties of terrestrial surfaces. However, existing three-dimensio...
The paper introduces OmniRSCLIP, an end‑to‑end contrastive learning framework that extends the CLIP architecture to handle heterogeneous remote sensing sensors such as SAR, multi‑spectral imaging, and hyperspectral imaging. It achieves this by employing Spectral‑Spatial Basis Decomposition to adapt arbitrary‑channel inputs without losing pretrained visual knowledge, and a spectral‑context‑aware mask‑based contrastive learning scheme to improve fine‑grained image‑text alignment. The authors also build OmniRS5M, a large‑scale image‑text corpus covering multiple sensor modalities, and demonstrate that OmniRSCLIP maintains strong RGB performance while effectively supporting these diverse remote sensing data types.
arXiv:2604.08884v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on RGB image understanding, yet their ability to use spectral evide...