arXiv Computer Vision

ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation

arXiv Computer Vision
Sep 2

C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation

C‑DiffSET is a SAR‑to‑EO image translation framework that uses a pretrained Latent Diffusion Model to adapt SAR imagery to the EO domain. The method exploits the pretrained VAE encoder’s ability to map SAR and EO images into a shared latent space, even when SAR inputs contain varying noise levels. A confidence‑guided diffusion loss further improves pixel‑wise fidelity by reducing artifacts such as appearing or disappearing objects, leading to state‑of‑the‑art results across multiple datasets.

By Jeonghyeok Do, Jaehyup Lee, Munchurl Kim
arXiv Machine Learning
Sep 10

Cross-modal learning for SAR target recognition using optical vision foundation models

The paper proposes a cross‑modal framework that uses a frozen DINOv3 optical vision foundation model to create class‑level prototypes for Synthetic Aperture Radar (SAR) target recognition. By aligning SAR embeddings to these optical prototypes, the SAR model learns to classify SAR images without needing paired optical data. Experiments on the UNICORNv2 dataset show that this prototype alignment improves SAR classification accuracy compared to baseline methods and yields clearer class separation in the embedding space.

By Lucas Hirsch, James R. Hopgood, Javid Khan, Yoann Altmann, Mike E. Davies
arXiv Computer Vision
Oct 8

SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models

SAREO‑FM is a foundation model that separates semantic supervision from reconstruction supervision in synthetic aperture radar (SAR) and electro‑optical (EO) imagery. It uses modality tokens for masked reconstruction and learnable semantic queries guided by a pretrained vision foundation model to capture scene content. Trained on the million‑scale SAR‑1M corpus, the model shows strong unimodal transfer for SAR and EO alone and significant improvements when both modalities are combined.

By Jeonghyeok Do, Munchurl Kim
arXiv Computer Vision
Oct 16

Data-Efficient ConvNeXt Pretraining for High-Resolution Sentinel-1 GRD SAR Representation Learning

The paper introduces SparK-SAR, a sparse convolutional masked pretraining framework that leverages ConvNeXt for high‑resolution Sentinel‑1 GRD SAR data. It presents three key contributions: a domain‑adapted ConvNeXt‑RS encoder with a reduced stem stride, a lightweight ConvNeXt‑512 decoder that cuts VRAM usage while matching UNet accuracy, and an analysis of FP16 instability and layer‑wise learning‑rate decay benefits. Experiments on four Copernicus‑Bench S1GRD tasks show that the 27.8 M‑parameter ConvNeXt‑RS encoder outperforms a larger ViT baseline on most tasks and demonstrates strong data efficiency, with classification saturating at 10–25 % of the SSL4EO‑S12 corpus.

By Yuki Natsume, Sang-Ho Yun, Chai Kiat Yeo
arXiv Computer Vision
Sep 25

OptiSAR-Net++: A Large-Scale Benchmark and Transformer-Free Framework for Cross-Domain Remote Sensing Visual Grounding

OptiSAR-Net++ introduces a new cross‑domain remote sensing visual grounding task (CD‑RSVG) and the first large‑scale benchmark dataset, OptSAR‑RSVG. The framework replaces Transformer decoding with a CLIP‑based contrastive approach, employing a patch‑level Low‑Rank Adaptation Mixture of Experts for efficient cross‑domain feature decoupling and a text‑guided dual‑gate fusion module for improved semantic‑visual alignment. Experiments show state‑of‑the‑art performance on OptSAR‑RSVG and DIOR‑RSVG, with notable gains in localization accuracy and computational efficiency.

By Xiaoyu Tang, Jun Dong, Jintao Cheng, Rui Fan
arXiv Computer Vision
Sep 7

Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation

The paper introduces BMT, a unified hierarchical Vision Transformer that jointly performs SAR-to-optical image translation and semantic segmentation. It incorporates a LocalViTBlock, an enhanced output module, a ControlNet-style conditional injection, and a bounded Kendall uncertainty weighting scheme to balance the two tasks. Experiments on paired and unpaired datasets demonstrate competitive performance in both translation quality and segmentation accuracy.

By Siyuan Liu, Xuze Zhang, Yongshun Wang, Licong Pan, Hang Liu, Huihui Li
arXiv Computer Vision
Sep 28

FuseReg: Regularizing Layer Fusion Mitigates the Reconstruction-Generation Gap in Representation Autoencoders

arXiv:2609.31620v1 Announce Type: new Abstract: Representation autoencoders (RAEs) reuse features from a pretrained visual encoder as reconstruction and diffusion latents, integrating strong visual r...

By Hongyang Du, Yunfei Xie, Junjie Ye, Jiawei Yang, Xiaoyan Cong, Haodong Zhang, Yongchao Huang, Haiyu Wu, Zongxia Li, Shihang Gui, Dawei Liu, Runhao Li, Jingcheng Ni, Chen Wei, Randall Balestriero, Yue Wang