Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2511. 13020v2 Announce Type: replace-cross Abstract: Although hyperspectral imaging offers unparalleled non-invasive physiological insight, its bulky hardware, slow acquisition, and regulatory burden severely limit its clinical availability.
arXiv:2609.01060v1 Announce Type: cross Abstract: Compact snapshot hyperspectral cameras provide rich instantaneous spectral measurements for ground-level machine vision, but at lower spatial resolut...
The paper introduces TSR-ITNR, a two‑stage, self‑supervised framework for hyperspectral image super‑resolution that fuses high‑resolution multispectral and low‑resolution hyperspectral data. Stage 1 refines an implicit Tucker representation using a low‑rank spatial tensor and spectral basis, enhanced by a pretrained denoiser, to capture fine spatial details and spectral correlations. Stage 2 applies parameter‑free calibration to extract complementary corrections from both observations, preserving geometry and ensuring orthogonal complementarity, leading to superior reconstruction quality demonstrated on benchmark datasets and improved downstream segmentation performance.
HyVIC is a configurable variational autoencoder designed for hyperspectral image compression that explicitly separates spatial and spectral feature learning. By allowing independent control of these two aspects, the architecture improves reconstruction fidelity across a wide range of compression ratios, achieving up to 4.66 dB better BD‑PSNR than previous methods. The authors also introduce a metric‑driven strategy for hyperparameter selection and provide code and pretrained models publicly.
arXiv:2505.08123v2 Announce Type: replace-cross Abstract: Multi-material decomposition (MMD) enables quantitative reconstruction of tissue compositions in the human body, supporting a wide range of c...
The paper introduces two lightweight spectral adapters—Directional Spectral Adapter (DiSECT) and Spectral Instance-Guided Adapter (SiGA)—to adapt the Segment Anything Model (SAM) for accurate segmentation of colorectal liver metastases in contrast‑enhanced CT scans. SiGA achieves the highest single‑point Dice score of 0.77 and performs comparably to a 3D nnU‑Net baseline under no‑prompt inference, while DiSECT requires only 0.14 million trainable parameters. The study evaluates the adapters on 446 CT volumes across various prompting regimes, demonstrating that spectral adapters can efficiently adapt SAM with limited trainable parameters while maintaining strong segmentation accuracy.