arXiv Computer Vision By Hao Zhang, Zhiqian Zheng, Linfeng Tang, Xinyu Xiang, Jiayi Ma

AD-SRF: Attack-Defense Semantic Reinforcement for Multi-Modal Image Fusion

Read the original on arXiv Computer Vision →

The paper introduces AD‑SRF, an attack‑defense semantic reinforcement framework for multi‑modal image fusion that separates visual quality and semantic attribute optimization and then recombines them. It employs a transformer‑based visual fusion network with a cross‑modal retrieval module and a collaborative loss to produce high‑quality fused images, even under degraded conditions. An adversarial game between an attacker that degrades segmentation and a defender that restores and reintegrates semantics via an imperceptible map iteratively enhances semantic attributes without sacrificing visual fidelity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
2d ago

Win-Win Fusion: Multi-Modal Image Fusion with Visual-Semantic Collaboration

The paper introduces W2F, a visual‑semantic mutual‑reinforcing framework for multi‑modal image fusion (MMIF). It enhances feature complementarity with a segmentation‑guided fusion loss and an embedded information restoration prior, and employs interactive gated mixed attention (IGM‑Att) and progressive coupling attention (PC‑Att) to fuse local and global information. A collaborative mechanism with a feature search module and gradient correction further aligns visual and semantic fusion, leading to state‑of‑the‑art visual appeal and decision accuracy.

By Hao Zhang, Xuhui Zuo, Jiayi Ma
Hugging Face Trending Papers
Aug 13

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.