arXiv Computer Vision By Haifa Zhang, Yijing Wang, Zhiqiang Zuo

Can BEV Perception Gracefully Degrade under Sensor Failures?

Read the original on arXiv Computer Vision →

The paper introduces Grace-BEV, a lightweight framework that enhances the robustness of Lift‑Splat‑Shoot (LSS) based bird’s‑eye view (BEV) perception models against sensor corruptions. Grace‑BEV operates in aligned BEV space, combining a LiDAR‑guided image‑BEV expert with a LiDAR‑independent visual expert, and uses a TrustGate Router and FailSafe Fusion Block to mix and recalibrate their outputs. Experiments on nuScenes-R and nuScenes-C show that Grace‑BEV maintains strong performance under diverse corruptions, recovers up to 34.7 mAP when LiDAR is lost, and even improves clean accuracy by up to 1.4 mAP with only 1.2M additional parameters.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 7

Post Fusion Bird's Eye View Feature Stabilization for Robust Multimodal 3D Detection

The paper introduces Post Fusion Stabilizer (PFS), a lightweight module that refines intermediate bird’s‑eye view (BEV) feature maps in existing camera‑LiDAR fusion detectors. PFS stabilizes feature statistics under domain shift, suppresses regions affected by sensor degradation, and adaptively restores weakened cues via residual correction, acting as a near‑identity transformation. On the nuScenes benchmark, PFS achieves state‑of‑the‑art robustness, notably improving camera dropout robustness by +1.2% and low‑light performance by +4.4% mAP while adding only 3.3 M parameters.

By Trung Tien Dong, Dev Thakkar, Arman Sargolzaei, Xiaomin Lin
arXiv Computer Vision
Aug 26

Variance-Guided Spatial Attention Fusion for Robust End-to-End Driving under Asymmetric Sensor Degradation

The paper introduces Variance‑Guided Spatial Attention Fusion (VG‑SAF), a method for robust end‑to‑end driving that fuses camera and LiDAR data while handling asymmetric sensor degradation. VG‑SAF uses a physically grounded augmentor to generate dense reliability masks, modality‑specific experts to predict per‑pixel reliability scales, and a hybrid attention mechanism that gates unreliable cells and balances modalities. The approach also includes a Laplace uncertainty head to signal severe or combined sensor failures, and demonstrates improved closed‑loop robustness on the CARLA Longest6 benchmark across various degradation scenarios.

By Weizhi Tao, Zengwang Jin, Xiao Wang, Hailong Huang
arXiv AI
Sep 25

SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

SARFusion introduces a scene-aware routing approach for camera‑LiDAR 3D object detection, decoupling object‑query decoding into separate camera, LiDAR, and fusion branches. By estimating a global scene reliability prior and incorporating object‑level evidence, each query is routed to the most suitable branch, reducing cross‑modal interference. The method achieves strong performance on the nuScenes test set (72.5 mAP, 74.4 NDS) and demonstrates robustness to sensor corruptions and environmental changes.

By Yuting Zhao, Ziyi Zheng, Shuxiao Li
arXiv AI
Oct 27

Sparse Recovery Bird's-Eye View Model Soup for Robust Camera-Based 3D Object Detection

The paper introduces SR‑BEVS, a sparse recovery learning technique that enhances both clean accuracy and robustness to real‑world corruptions for camera‑based bird’s‑eye view (BEV) 3D object detection models. By pruning weights based on magnitude, generating diverse sparse models, retraining them with varied learning rates, and averaging the recovered models into a single dense model, the method achieves up to 33.8% improvement in corruption robustness and a 1.8% gain in clean accuracy over the Fast‑BEV baseline on the nuScenes dataset. The approach adds no inference overhead and preserves a connected low‑loss basin, suggesting applicability to other BEV models.

By Jinwoo Chung, Sangho An, Hyunsung Park, Jangho Kim