arXiv:2608. 09202v1 Announce Type: new Abstract: Modern autonomous vehicles are equipped with multiple sensors, such as cameras, LiDAR, and radar, for comprehensive environmental perception.
arXiv:2602. 19349v2 Announce Type: replace-cross Abstract: LiDAR-camera fusion enhances 3D panoptic segmentation by leveraging camera images to complement sparse LiDAR scans, but it also introduces a critical failure mode.
End-to-end multimodal driving has progressed rapidly by fusing camera and LiDAR streams. Existing pipelines remain fragile under asymmetric sensor degradation, where either an entire modality or only...
The paper introduces Variance‑Guided Spatial Attention Fusion (VG‑SAF), a method for robust end‑to‑end driving that fuses camera and LiDAR data while handling asymmetric sensor degradation. VG‑SAF uses a physically grounded augmentor to generate dense reliability masks, modality‑specific experts to predict per‑pixel reliability scales, and a hybrid attention mechanism that gates unreliable cells and balances modalities. The approach also includes a Laplace uncertainty head to signal severe or combined sensor failures, and demonstrates improved closed‑loop robustness on the CARLA Longest6 benchmark across various degradation scenarios.
arXiv:2606. 01277v1 Announce Type: cross Abstract: Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encounters, specifically sudden pedestrian crossings.
SARFusion introduces a scene-aware routing approach for camera‑LiDAR 3D object detection, decoupling object‑query decoding into separate camera, LiDAR, and fusion branches. By estimating a global scene reliability prior and incorporating object‑level evidence, each query is routed to the most suitable branch, reducing cross‑modal interference. The method achieves strong performance on the nuScenes test set (72.5 mAP, 74.4 NDS) and demonstrates robustness to sensor corruptions and environmental changes.
The paper introduces TempLoc, a Temporal‑aware Localization framework that improves outdoor LiDAR relocalization by leveraging spatio‑temporal consistency across scans. It first predicts point‑wise global coordinates with uncertainties, then estimates inter‑frame correspondences using an attention‑based Prior Coordinate Generation module, and finally fuses these predictions in an uncertainty‑guided manner to produce a more accurate global 6‑DoF pose. Experiments on the NCLT and Oxford RobotCar datasets show that TempLoc significantly outperforms existing state‑of‑the‑art methods.
Multi-modality data from different sensors provides rich complementary information for 3D perception, becoming an essential component in reliable autonomous driving systems. Current research typically designs intricate and complex fusion strategies to integrate information from multimodal data on a unified bird's-eye-view (BEV) feature map for the joint learning of multiple perception tasks.
arXiv:2608.20890v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have emerged as a powerful paradigm for end-to-end autonomous driving by jointly integrating perception, reasoning,...
arXiv:2609.23541v1 Announce Type: new Abstract: Multimodal 3D object detection is fundamental to robust perception in autonomous driving because it integrates complementary information from LiDAR and...
DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.
The paper introduces a multi‑modal traffic sign detection framework that fuses camera and LiDAR data using an Intensity‑Aware Deformable Fusion module to align retro‑reflective LiDAR cues with visual features. It also presents a dual motion‑model tracker to handle non‑linear perspective changes and a semantic attribute classification pipeline that estimates occlusion, readability, sign embeddedness, and road relevance. Evaluated on a dataset covering more than 60 countries and 2,500 hours of driving, the system achieves an Object Miss Ratio of 0.49% across 221,068 sequences, indicating strong global generalization for autonomous driving.
arXiv:2601. 20720v2 Announce Type: replace-cross Abstract: End-to-end perception and trajectory prediction from raw sensor data is one of the key capabilities for autonomous driving.