arXiv Computer Vision

MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection

MIC-BEV is a Transformer-based bird's-eye-view perception framework designed for infrastructure-based multi-camera 3D object detection. It supports a variable number of heterogeneous cameras and employs a graph-enhanced fusion module to adaptively integrate multi-view image features by modeling geometric relationships between cameras and the BEV grid. The authors introduce the M2I synthetic dataset and evaluate MIC-BEV on both M2I and the real-world RoScenes dataset, demonstrating strong detection performance, improved robustness under challenging conditions, and practical feasibility for deployment.

Hugging Face Trending Papers
Jul 27

MATS: A novel multi-modality multi-task learning framework for 3D perception in autonomous driving

Multi-modality data from different sensors provides rich complementary information for 3D perception, becoming an essential component in reliable autonomous driving systems. Current research typically designs intricate and complex fusion strategies to integrate information from multimodal data on a unified bird's-eye-view (BEV) feature map for the joint learning of multiple perception tasks.

arXiv AI
Sep 7

Post Fusion Bird's Eye View Feature Stabilization for Robust Multimodal 3D Detection

The paper introduces Post Fusion Stabilizer (PFS), a lightweight module that refines intermediate bird’s‑eye view (BEV) feature maps in existing camera‑LiDAR fusion detectors. PFS stabilizes feature statistics under domain shift, suppresses regions affected by sensor degradation, and adaptively restores weakened cues via residual correction, acting as a near‑identity transformation. On the nuScenes benchmark, PFS achieves state‑of‑the‑art robustness, notably improving camera dropout robustness by +1.2% and low‑light performance by +4.4% mAP while adding only 3.3 M parameters.

By Trung Tien Dong, Dev Thakkar, Arman Sargolzaei, Xiaomin Lin
arXiv Computer Vision
6d ago

FastBEVFusion: Simple Multi-Modal Fusion for 3D Object Detection at 50 FPS

FastBEVFusion is a lightweight fusion system for real‑time 3D object detection that combines LiDAR and camera data without depth estimation. It projects modality‑specific features into semi‑aligned BEV spaces and fuses them with a dynamic cross‑attention module, achieving over 50 FPS on the nuScenes dataset. The method also demonstrates strong robustness to calibration errors.

By Tom Sanitz, Emre G\"ulsoylu, Simone Frintrop, Christian Wilms
arXiv AI
Jul 7

BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations

arXiv:2603. 06576v2 Announce Type: replace-cross Abstract: The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail scenarios.

By Thomas Monninger, Shaoyuan Xie, Qi Alfred Chen, Sihao Ding
arXiv AI
Sep 25

SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

SARFusion introduces a scene-aware routing approach for camera‑LiDAR 3D object detection, decoupling object‑query decoding into separate camera, LiDAR, and fusion branches. By estimating a global scene reliability prior and incorporating object‑level evidence, each query is routed to the most suitable branch, reducing cross‑modal interference. The method achieves strong performance on the nuScenes test set (72.5 mAP, 74.4 NDS) and demonstrates robustness to sensor corruptions and environmental changes.

By Yuting Zhao, Ziyi Zheng, Shuxiao Li
arXiv AI
Oct 27

Sparse Recovery Bird's-Eye View Model Soup for Robust Camera-Based 3D Object Detection

The paper introduces SR‑BEVS, a sparse recovery learning technique that enhances both clean accuracy and robustness to real‑world corruptions for camera‑based bird’s‑eye view (BEV) 3D object detection models. By pruning weights based on magnitude, generating diverse sparse models, retraining them with varied learning rates, and averaging the recovered models into a single dense model, the method achieves up to 33.8% improvement in corruption robustness and a 1.8% gain in clean accuracy over the Fast‑BEV baseline on the nuScenes dataset. The approach adds no inference overhead and preserves a connected low‑loss basin, suggesting applicability to other BEV models.

By Jinwoo Chung, Sangho An, Hyunsung Park, Jangho Kim