arXiv AI
3d ago

Spectral Invariant Fusion and Refinement for Domain Generalized Semantic Segmentation

The paper introduces SIFR, a frequency-aware dual‑stream framework for domain‑generalized semantic segmentation. SIFR performs spectral‑guided invariant fusion of frozen CLIP and DINOv2 features to suppress domain‑sensitive responses while preserving semantic and structural cues, and adds a spectral decoder refinement module that normalizes low‑frequency statistics and adaptively selects frequencies to reduce residual domain bias. Experiments on synthetic‑to‑real, real‑to‑real, and adverse‑weather benchmarks show consistent improvements over prior state‑of‑the‑art methods.

By Yansong Bai, Yunzhi Zhuge, Xinzhuo Yu, Lu Zhang, Jin Zhan, Pingping Zhang, Huchuan Lu
Hugging Face Trending Papers
4d ago

Spectral Invariant Fusion and Refinement for Domain Generalized Semantic Segmentation

Spectral Invariant Fusion and Refinement for Domain Generalized Semantic Segmentation (SIFR) introduces a frequency-aware dual-stream framework that addresses domain shift by performing spectral-guided invariant fusion of frozen CLIP and DINOv2 features and a spectral decoder refinement module. The fusion stage filters out domain-sensitive responses while preserving complementary semantic and structural information, and the decoder stage stabilizes multi-scale features through low-frequency statistics-based normalization and adaptive frequency selection. Experiments on synthetic-to-real, real-to-real, and adverse-weather benchmarks show consistent improvements over previous state-of-the-art methods.

arXiv AI
Aug 19

Multi-Scale Spectral Attention Module-based Hyperspectral Segmentation in Autonomous Driving Scenarios

The paper investigates a Multi-Scale Spectral Attention Module (MSAM) for hyperspectral image segmentation in autonomous driving. MSAM uses three parallel 1D convolutions with different kernel sizes (1–11) and adaptive feature aggregation, integrated into UNet’s skip connections. Experiments on urban driving datasets show that MSAM improves mIoU by 2.32% and mF1 by 2.88% over baseline UNet-SC while keeping GPU performance competitive, with optimal kernel combinations varying by dataset.

By Imad Ali Shah, Jiarong Li, Tim Brophy, Martin Glavin, Edward Jones, Enda Ward, Brian Deegan
arXiv Computer Vision
Sep 15

MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery

MambaMPD is a new segmentation framework that leverages Vision Mamba models for marine pollution detection in remote‑sensing imagery. It introduces two structural priors—Frequency‑Aware Augmentation (FAA) and multi‑scale Edge‑Guided Attention (EGA)—to better capture low‑contrast, fragmented pollution patterns and sharpen boundaries. Experiments on the MADOS and M4D datasets show that MambaMPD outperforms existing methods in mIoU while using far less computation than foundation‑model approaches.

By Shuaiyu Chen, Wei Han, Peng Ren, Chunbo Luo, Zeyu Fu