arXiv AI

DeeperRadar: End-to-End MIMO Radar Design and Multi-Modal Fusion for Autonomous Vehicle Perception

arXiv:2607. 17351v1 Announce Type: new Abstract: DeeperRadar is a radar-centric, sensor-stack-conditioned framework that co-designs radar sensing and multi-modal 3D detection for autonomous mobility by learning a sparse acquisition pattern end-to-end with the fusion model.

arXiv Computer Vision
Sep 18

4D Radar Perception Algorithms for Autonomous Driving: A Review

The review surveys 4D millimeter‑wave radar perception algorithms for autonomous driving, covering signal processing, object detection, semantic segmentation, motion estimation, occupancy prediction, and dynamic scene reconstruction. It organizes the field by perception tasks, discusses radar fundamentals, data representations, and quality‑enhancement methods, and compares radar‑only learning, multimodal fusion, and cross‑modal supervision. The paper also summarizes datasets, annotations, evaluation protocols, and outlines common challenges and future research directions.

By Xumin Wu, Jun Zhou, Jilin Mei, Chen Min, Yu Hu
arXiv Machine Learning
Sep 22

On Learning Spatial Structure from Pre-Beamforming Per-Antenna Range-Doppler Radar Measurements

This study explores whether spatial structure can be learned directly from pre-beamforming per-antenna range-Doppler (RD) radar measurements, bypassing traditional beamforming steps. Using a 6‑TX × 8‑RX automotive radar with a chirp‑sequence FMCW transmit scheme, the authors train a dual‑chirp shared‑weight encoder on raw RD tensors and evaluate spatial recoverability via bird’s‑eye‑view occupancy maps. Experiments across different transmit configurations (A‑only, B‑only, A+B) and receive apertures demonstrate that meaningful spatial structure is indeed recoverable through learned spatial mixing, without hand‑crafted signal‑processing stages.

By George Sebastian, Philipp Berthold, Bianca Forkel, Leon Pohl, Mirko Maehlisch
arXiv Computer Vision
Sep 3

Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding

The paper presents a lightweight method to adapt general‑purpose vision‑language models (VLMs) for multispectral and synthetic aperture radar (SAR) image understanding. By rendering each observation as five optical views and one SAR view, naming them in the prompt, and applying LoRA to the language network and selected visual transformer blocks, the authors enable VLMs to process band composites, spectral indices, and radar backscatter without retraining a new foundation model. On a balanced six‑class land‑cover benchmark from BigEarthNet‑v2, the adapted Qwen3‑VL achieves a micro F1 of 0.8275, and the same protocol improves four other VLMs and transfers to flood verification and captioning tasks. "whyItMatters":"The study shows that existing VLMs can be repurposed for multispectral and SAR tasks through simple input rendering and compact LoRA adaptation, avoiding the need for dedicated encoders and domain pretraining."

By Shanji Liu, Kelu Yao, Junxiao Xue, Chenghui Lv, Xiangyang Miao, Yekai Huang, Yaying Chen, Chao Li
arXiv Machine Learning
Jun 30

RadarTwin: Scene-Specific mmWave Radar Simulation and Learning for Mobile Indoor Perception

arXiv:2606. 28396v1 Announce Type: cross Abstract: Millimeter-wave (mmWave) radar perception is limited by data scarcity: models trained on existing radar datasets fail to generalize to new objects, environments, and sensing trajectories.

By Emily Bejerano, Federico Tondolo, Devang Gupta, Aaron Mano Cherian, Taeyoo Kim, Ayaan Qayyum, Xiaofan Yu, Xiaofan Jiang