arXiv Computer Vision

Context-Guided Semantic Alignment for Feature Fusion Networks

The paper introduces Feature Interaction Network (FINE), a lightweight semantic alignment module for feature fusion networks in object detectors. FINE refines low‑level features using high‑level contextual guidance through cross‑level attention, and employs Alignment‑Aware Token Sampling to reduce attention complexity. The resulting spatial‑channel modulation map selectively enhances semantically relevant pixels while preserving sub‑pixel localization, leading to improved detection accuracy with minimal computational overhead.

arXiv Computer Vision
Sep 24

S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection

The paper introduces S2A, a semantic-to-spatial alignment framework designed for alignment‑free RGB‑T salient object detection. It employs a global‑guided hierarchical fusion module to refine intra‑modal features, an alignment‑free cross‑modal channel attention module to exchange semantic information, and a spatial deformable cross‑attention module to recover local spatial correspondence. These components collectively reduce misalignment‑induced feature contamination and achieve competitive performance on public benchmarks without additional bells and whistles.

By Qiangqiang Zhou, Yang Luo, Yong Chen, Jiawei Xu
arXiv Computer Vision
Aug 25

Deep Multimodal Fusion Detection through Spatial Mask and Channel Competition

The paper introduces an Attention-Driven Complementarity Resampling framework to enhance cross-modality object detection. It employs a shared channel spatial attention mechanism that exchanges semantic masks between modalities, encouraging the backbone to learn generalized features. Additionally, a learnable channel competition module samples and aggregates features channel‑wise, improving robustness and achieving competitive results on multiple datasets.

By Guandi Wang, Ming Li, Yunsen Xing, Junle Liu
arXiv Computer Vision
2d ago

Win-Win Fusion: Multi-Modal Image Fusion with Visual-Semantic Collaboration

The paper introduces W2F, a visual‑semantic mutual‑reinforcing framework for multi‑modal image fusion (MMIF). It enhances feature complementarity with a segmentation‑guided fusion loss and an embedded information restoration prior, and employs interactive gated mixed attention (IGM‑Att) and progressive coupling attention (PC‑Att) to fuse local and global information. A collaborative mechanism with a feature search module and gradient correction further aligns visual and semantic fusion, leading to state‑of‑the‑art visual appeal and decision accuracy.

By Hao Zhang, Xuhui Zuo, Jiayi Ma
arXiv Computer Vision
Sep 23

Shallow to Deep: Aligning Token Pruning with Stage-wise Roles in LVLMs

The paper introduces STD, a hierarchical token pruning framework for Large Vision‑Language Models that aligns pruning strategies with the functional roles of different network stages. By using high‑frequency spectral analysis in shallow layers, Gaussian‑smoothed attention in intermediate layers, and a stability‑adaptive trigger in deep layers, STD preserves essential visual information while aggressively reducing token counts. Experiments demonstrate that STD outperforms existing pruning methods, achieving up to 94.4% token reduction and a 3.9× speed‑up on LLaVA‑NeXT‑7B.

By Shuo Zhang, Jintao Tong, Yixiong Zou, Yuhua Li, Ruixuan Li