The paper introduces a multi‑modal late‑fusion perception pipeline for object detection and tracking in autonomous racing. It combines independent detections from cameras, LiDARs, and RADARs to produce timely and robust state estimates of surrounding vehicles. The tracking framework compensates for detection delays and incorporates vehicle dynamics and track layout knowledge, and its effectiveness is confirmed through real‑world experiments in diverse critical scenarios.
arXiv:2608. 09202v1 Announce Type: new Abstract: Modern autonomous vehicles are equipped with multiple sensors, such as cameras, LiDAR, and radar, for comprehensive environmental perception.
The paper introduces a multi‑modal traffic sign detection framework that fuses camera and LiDAR data using an Intensity‑Aware Deformable Fusion module to align retro‑reflective LiDAR cues with visual features. It also presents a dual motion‑model tracker to handle non‑linear perspective changes and a semantic attribute classification pipeline that estimates occlusion, readability, sign embeddedness, and road relevance. Evaluated on a dataset covering more than 60 countries and 2,500 hours of driving, the system achieves an Object Miss Ratio of 0.49% across 221,068 sequences, indicating strong global generalization for autonomous driving.
The paper surveys one‑stage object detectors for autonomous driving, covering the evolution from early models like YOLOv1 and SSD to recent real‑time architectures such as YOLOv10 and anchor‑free detectors like FCOS and CenterNet. It compares these methods on design choices, feature‑fusion strategies, loss functions, deployment trade‑offs, and benchmark performance, while also summarizing datasets, evaluation metrics, open challenges, and future research directions. The survey emphasizes how one‑stage detectors balance speed, accuracy, efficiency, and robustness, noting the gap between benchmark results and dependable real‑world performance.
arXiv:2606. 01277v1 Announce Type: cross Abstract: Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encounters, specifically sudden pedestrian crossings.
FastBEVFusion is a lightweight fusion system for real‑time 3D object detection that combines LiDAR and camera data without depth estimation. It projects modality‑specific features into semi‑aligned BEV spaces and fuses them with a dynamic cross‑attention module, achieving over 50 FPS on the nuScenes dataset. The method also demonstrates strong robustness to calibration errors.
The paper introduces a Motion Dynamics Kalman Filter (MD‑KF) for 3D multi‑object tracking that adapts to motion variation while keeping a single‑model structure. It improves state estimation by scaling motion components to reduce drift, especially for distant or occluded objects. Experiments on KITTI, Waymo Open Dataset, and real vehicle tests show MD‑KF matches multimodel KF performance with a 1.72× speedup.
arXiv:2609.32013v2 Announce Type: replace-cross Abstract: We present TriO, a multi-modal unsupervised world model that predicts 4D occupancy, obstacle segmentation, flow and LiDAR. In contrast to pri...
HENet++ is a unified framework that combines a hybrid image encoding strategy—using a large encoder for short‑term frames and a lightweight encoder for long‑term temporal context—to balance accuracy and efficiency in 3D perception for autonomous driving. It jointly extracts dense background and sparse foreground features, enabling task‑specific representations that reduce cumulative errors and enrich downstream prediction and planning modules. The approach supports diverse 3D feature extraction pipelines, multi‑modal inputs (camera and radar), and achieves state‑of‑the‑art results on nuScenes and NAVSIM benchmarks, including the lowest collision rate on nuScenes planning.
Reliable motion classification is critical for autonomous driving, as false dynamic predictions of static objects can cascade into unnecessary planner interventions. Unstable bounding box predictions can lead to spurious velocity estimates in tracking and falsely predicted trajectories.
arXiv:2606. 02979v1 Announce Type: cross Abstract: We present a novel compact deep multi-task learning model to handle various autonomous driving perception tasks in one forward pass.
arXiv:2607. 19528v1 Announce Type: cross Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have triggered the development of end-to-end MLLMs for autonomous driving.
Multi-modality data from different sensors provides rich complementary information for 3D perception, becoming an essential component in reliable autonomous driving systems. Current research typically designs intricate and complex fusion strategies to integrate information from multimodal data on a unified bird's-eye-view (BEV) feature map for the joint learning of multiple perception tasks.