arXiv Computer Vision

C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation

C‑DiffSET is a SAR‑to‑EO image translation framework that uses a pretrained Latent Diffusion Model to adapt SAR imagery to the EO domain. The method exploits the pretrained VAE encoder’s ability to map SAR and EO images into a shared latent space, even when SAR inputs contain varying noise levels. A confidence‑guided diffusion loss further improves pixel‑wise fidelity by reducing artifacts such as appearing or disappearing objects, leading to state‑of‑the‑art results across multiple datasets.

arXiv Computer Vision
Oct 8

SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models

SAREO‑FM is a foundation model that separates semantic supervision from reconstruction supervision in synthetic aperture radar (SAR) and electro‑optical (EO) imagery. It uses modality tokens for masked reconstruction and learnable semantic queries guided by a pretrained vision foundation model to capture scene content. Trained on the million‑scale SAR‑1M corpus, the model shows strong unimodal transfer for SAR and EO alone and significant improvements when both modalities are combined.

By Jeonghyeok Do, Munchurl Kim
arXiv Machine Learning
Sep 10

Cross-modal learning for SAR target recognition using optical vision foundation models

The paper proposes a cross‑modal framework that uses a frozen DINOv3 optical vision foundation model to create class‑level prototypes for Synthetic Aperture Radar (SAR) target recognition. By aligning SAR embeddings to these optical prototypes, the SAR model learns to classify SAR images without needing paired optical data. Experiments on the UNICORNv2 dataset show that this prototype alignment improves SAR classification accuracy compared to baseline methods and yields clearer class separation in the embedding space.

By Lucas Hirsch, James R. Hopgood, Javid Khan, Yoann Altmann, Mike E. Davies
arXiv Computer Vision
Sep 7

Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation

The paper introduces BMT, a unified hierarchical Vision Transformer that jointly performs SAR-to-optical image translation and semantic segmentation. It incorporates a LocalViTBlock, an enhanced output module, a ControlNet-style conditional injection, and a bounded Kendall uncertainty weighting scheme to balance the two tasks. Experiments on paired and unpaired datasets demonstrate competitive performance in both translation quality and segmentation accuracy.

By Siyuan Liu, Xuze Zhang, Yongshun Wang, Licong Pan, Hang Liu, Huihui Li
arXiv Computer Vision
Sep 3

ProSR: Semantic-Prototype-Guided Discrete Modeling for Physically Consistent SAR Super-Resolution

ProSR is a new method for Synthetic Aperture Radar (SAR) super‑resolution that treats the task as a discrete token prediction problem in a quantized latent space. By mapping SAR signal features to discrete scattering primitives and using a self‑supervised backbone to extract label‑free semantic priors, ProSR preserves the impulsive, physically consistent scattering statistics of SAR images. The approach includes Semantic‑Aligned Detail Encoding and a Prototype‑Map‑Guided Attention mechanism, and it has been validated on a large‑scale 0.25 m resolution benchmark from the Umbra Open Dataset, achieving superior visual quality while maintaining essential scattering characteristics.

By Byoungwoo Kim, Munchurl Kim
arXiv Machine Learning
Oct 19

Data-Efficient Classifier Pretraining Through Diffusion Models

The paper introduces DiffPT, a diffusion‑based pretraining method for classifier backbones aimed at improving performance when training data is scarce. Experiments on time‑series, natural image, and medical imaging datasets show that DiffPT outperforms many self‑supervised baselines, especially in low‑data regimes for medical and time‑series tasks. While contrastive pretraining remains superior on CIFAR‑10 and Tiny ImageNet, DiffPT offers a simple and effective alternative across diverse modalities.

By Qinyu Li, Yee Whye Teh, Chris Holmes, Joel Jaskari