Towards robust multimodal 3D object detection via visual foundation models
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2404.09431v3 Announce Type: replace Abstract: Pseudo-LiDAR has become a promising paradigm for monocular 3D object detection by transforming monocular images into point cloud representations th...
Recent advancements in LiDAR-only 3D object detection have demonstrated improved detection accuracy over benchmark datasets. However, the adversarial robustness of these models remains untested.
SARFusion introduces a scene-aware routing approach for camera‑LiDAR 3D object detection, decoupling object‑query decoding into separate camera, LiDAR, and fusion branches. By estimating a global scene reliability prior and incorporating object‑level evidence, each query is routed to the most suitable branch, reducing cross‑modal interference. The method achieves strong performance on the nuScenes test set (72.5 mAP, 74.4 NDS) and demonstrates robustness to sensor corruptions and environmental changes.
arXiv:2510.10471v3 Announce Type: replace-cross Abstract: Environmental perception systems are crucial for high-precision mapping and autonomous navigation, with LiDAR serving as a core sensor provid...
FastBEVFusion is a lightweight fusion system for real‑time 3D object detection that combines LiDAR and camera data without depth estimation. It projects modality‑specific features into semi‑aligned BEV spaces and fuses them with a dynamic cross‑attention module, achieving over 50 FPS on the nuScenes dataset. The method also demonstrates strong robustness to calibration errors.
AutoExpert proposes a new benchmark for automating 3D LiDAR annotation using expert‑crafted guidelines, redefining evaluation protocols and re‑annotating nuScenes and PandaSet datasets. The pipeline combines 2D detection and segmentation in RGB images, lifts these detections into 3D with known sensor poses, and generates 3D cuboids, improving 3D detection mAP from 12.1 to 25.4 on the AutoExpert‑nuScenes benchmark.