The paper introduces BMT, a unified hierarchical Vision Transformer that jointly performs SAR-to-optical image translation and semantic segmentation. It incorporates a LocalViTBlock, an enhanced output module, a ControlNet-style conditional injection, and a bounded Kendall uncertainty weighting scheme to balance the two tasks. Experiments on paired and unpaired datasets demonstrate competitive performance in both translation quality and segmentation accuracy.
arXiv:2510. 22665v4 Announce Type: replace-cross Abstract: Synthetic Aperture Radar (SAR) is a critical imaging modality due to its all-weather operational capability.
OptiSAR-Net++ introduces a new cross‑domain remote sensing visual grounding task (CD‑RSVG) and the first large‑scale benchmark dataset, OptSAR‑RSVG. The framework replaces Transformer decoding with a CLIP‑based contrastive approach, employing a patch‑level Low‑Rank Adaptation Mixture of Experts for efficient cross‑domain feature decoupling and a text‑guided dual‑gate fusion module for improved semantic‑visual alignment. Experiments show state‑of‑the‑art performance on OptSAR‑RSVG and DIOR‑RSVG, with notable gains in localization accuracy and computational efficiency.
The paper demonstrates a lightweight method to adapt general-purpose vision‑language models (VLMs) for multispectral and synthetic aperture radar (SAR) image understanding. By rendering each observation as five optical views and one SAR view, naming them in the prompt, and applying LoRA to the language network and selected visual transformer blocks, the authors enable VLMs to process band composites, spectral indices, and radar backscatter without retraining a new foundation model. On a balanced six‑class land‑cover benchmark from BigEarthNet‑v2, the adapted Qwen3‑VL achieves a micro F1 score of 0.8275, and the same protocol improves four other VLMs and transfers to flood verification and captioning tasks.
The paper introduces SARTM, a framework that adapts the Segment Anything Model (SAM) for RGB‑thermal (RGB‑T) semantic segmentation. It fine‑tunes SAM with LoRA layers, incorporates language guidance, and employs a Cross‑Modal Knowledge Distillation module to bridge modality gaps. The approach also modifies the segmentation head and adds an auxiliary semantic head, achieving superior performance on MFNET, PST900, and FMB benchmarks.
SAREO‑FM is a foundation model that separates semantic supervision from reconstruction supervision in synthetic aperture radar (SAR) and electro‑optical (EO) imagery. It uses modality tokens for masked reconstruction and learnable semantic queries guided by a pretrained vision foundation model to capture scene content. Trained on the million‑scale SAR‑1M corpus, the model shows strong unimodal transfer for SAR and EO alone and significant improvements when both modalities are combined.
arXiv:2609.37496v1 Announce Type: new Abstract: Paired synthetic aperture radar (SAR) and electro-optical (EO) imagery is increasingly available across sensors, resolutions, and geographic regions. Y...
arXiv:2607.23238v3 Announce Type: replace Abstract: Masked image modeling has become a dominant paradigm for SAR pre-training, yet the design of the reconstruction target remains fundamentally unsett...
The paper proposes a cross‑modal framework that uses a frozen DINOv3 optical vision foundation model to create class‑level prototypes for Synthetic Aperture Radar (SAR) target recognition. By aligning SAR embeddings to these optical prototypes, the SAR model learns to classify SAR images without needing paired optical data. Experiments on the UNICORNv2 dataset show that this prototype alignment improves SAR classification accuracy compared to baseline methods and yields clearer class separation in the embedding space.
The paper presents a lightweight method to adapt general‑purpose vision‑language models (VLMs) for multispectral and synthetic aperture radar (SAR) image understanding. By rendering each observation as five optical views and one SAR view, naming them in the prompt, and applying LoRA to the language network and selected visual transformer blocks, the authors enable VLMs to process band composites, spectral indices, and radar backscatter without retraining a new foundation model. On a balanced six‑class land‑cover benchmark from BigEarthNet‑v2, the adapted Qwen3‑VL achieves a micro F1 of 0.8275, and the same protocol improves four other VLMs and transfers to flood verification and captioning tasks. "whyItMatters":"The study shows that existing VLMs can be repurposed for multispectral and SAR tasks through simple input rendering and compact LoRA adaptation, avoiding the need for dedicated encoders and domain pretraining."
The paper introduces NWPU-Refer, the largest bilingual dataset for referring remote sensing image segmentation, featuring 15,003 high‑resolution images from over 30 countries and 49,745 annotated targets. It also proposes the Multi‑scale Referring Segmentation Network (MRSNet), which uses an Intra‑scale Feature Interaction Module to refine fine‑grained features and a Hierarchical Feature Interaction Module to fuse cross‑scale information while preserving spatial structure. Experiments on NWPU‑Refer and RRSIS‑D show that MRSNet achieves strong, competitive performance, especially under strict IoU thresholds, demonstrating the effectiveness of both the new dataset and the model.
OpenEarth-OVS44 is a new multimodal remote sensing dataset featuring 290,587 expert‑verified segments from 2,832 RGB images and 1,341 RGB‑SAR pairs at sub‑meter resolution, covering 40 cities in France, Japan, and the United States. It adopts a unified 44‑class taxonomy organized into nine base categories and offers three evaluation tracks: an RGB‑only fine‑grained benchmark, a multimodal track with synthetic cloudy conditions for weather‑robust evaluation, and a held‑out cross‑region track. Experiments show that training on OpenEarth-OVS44 improves fine‑grained segmentation performance, achieving up to 7.1 mIoU points on unseen categories and 27.6 mIoU points on seen categories compared to the strongest training‑free baseline.
The paper introduces OVRSISBench, a unified benchmark for open‑vocabulary remote sensing image segmentation, and evaluates existing OVS/OVRSIS models, uncovering their shortcomings in remote sensing contexts. Leveraging insights from this evaluation, the authors propose RSKT‑Seg, a new framework featuring a Multi‑Directional Cost Map Aggregation module, an Efficient Cost Map Fusion transformer, and a Remote Sensing Knowledge Transfer module. Experiments on the benchmark demonstrate that RSKT‑Seg outperforms strong baselines by +3.8 mIoU and +5.9 mACC while achieving twice the inference speed.