Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding
Read the original on arXiv Computer Vision →The paper presents a lightweight method to adapt general‑purpose vision‑language models (VLMs) for multispectral and synthetic aperture radar (SAR) image understanding. By rendering each observation as five optical views and one SAR view, naming them in the prompt, and applying LoRA to the language network and selected visual transformer blocks, the authors enable VLMs to process band composites, spectral indices, and radar backscatter without retraining a new foundation model. On a balanced six‑class land‑cover benchmark from BigEarthNet‑v2, the adapted Qwen3‑VL achieves a micro F1 of 0.8275, and the same protocol improves four other VLMs and transfers to flood verification and captioning tasks. "whyItMatters":"The study shows that existing VLMs can be repurposed for multispectral and SAR tasks through simple input rendering and compact LoRA adaptation, avoiding the need for dedicated encoders and domain pretraining."
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.