arXiv Computer Vision

CLFTv2: Efficient Camera-LiDAR Fusion for Semantic Segmentation via Hierarchical Feature Pyramids

arXiv AI
Jun 2

DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance

arXiv:2606. 01277v1 Announce Type: cross Abstract: Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encounters, specifically sudden pedestrian crossings.

By Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky, Jazi Eko Istiyanto, Jun Miura
arXiv Computer Vision
5d ago

FastBEVFusion: Simple Multi-Modal Fusion for 3D Object Detection at 50 FPS

FastBEVFusion is a lightweight fusion system for real‑time 3D object detection that combines LiDAR and camera data without depth estimation. It projects modality‑specific features into semi‑aligned BEV spaces and fuses them with a dynamic cross‑attention module, achieving over 50 FPS on the nuScenes dataset. The method also demonstrates strong robustness to calibration errors.

By Tom Sanitz, Emre G\"ulsoylu, Simone Frintrop, Christian Wilms
arXiv Machine Learning
Jul 28

SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception

arXiv:2607. 23910v1 Announce Type: cross Abstract: Cooperative perception through vehicle-to-everything (V2X) communication can overcome the inherent physical limitations of individual autonomous vehicles, such as occlusions and limited sensor range.

By Goodarz Mehr, Sepideh Gohari, Montasir Abbas, Azim Eskandarian
arXiv Computer Vision
Sep 17

LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation

LiteViLNet is a lightweight RGB‑geometry fusion network for road segmentation that uses a MobileNetV3 RGB encoder and a tiny depth‑wise‑separable geometry encoder. Its multi‑scale fusion module enhances modality‑specific features, performs cross‑modal interaction, and applies adaptive gating, while a depth‑wise large‑kernel bridge expands contextual support with minimal overhead. The U‑Net‑style decoder is trained with deep supervision, achieving state‑of‑the‑art performance on KITTI and ORFD benchmarks and running at up to 68.73 FPS on a Jetson Orin NX with TensorRT FP16.

By Daojie Peng, Bingtao Wang, Fulong Ma, Liang Zhang, Jun Ma
arXiv Computer Vision
Oct 23

Foundation4D: Towards a unified perception and reconstruction model for autonomous vehicles

Foundation4D is a unified feed‑forward model that performs geometry estimation, 3D detection, semantic occupancy, and Gaussian reconstruction from multi‑camera driving video. It uses a shared backbone with factorized spatiotemporal attention to merge observations across cameras and time, and a video inference pipeline that refines camera trajectories via pose graph optimization and assembles object tracks. The authors also provide a data annotation pipeline and release the PAI‑Foundation4D benchmark, achieving state‑of‑the‑art results on depth, detection, and occupancy metrics and demonstrating that co‑training detection with geometry and occupancy improves performance.

By NVIDIA, :, S\'ergio Agostinho, Maximilian Apodaca, Emmanuel Attia, Guillem Braso, George Dong, Ilya Fedorov, Michele Fenzi, Gang Huang, Jiahui Huang, Shengyu Huang, Bingxin Ke, Laura Leal-Taix\'e, Kuan-Ting Lee, Mingxuan Liu, Tian Liu, Tim Meinhardt, Aljo\v{s}a O\v{s}ep, Naveen Kumar Rai, Kefei Ren, Cristiano Saltori, Keqiang Wu, Ning Xu, Fei Xue, Jin-Bey Yu, Lei Zhang, Qunjie Zhou
arXiv Computer Vision
Aug 24

Multi-Modal Traffic Sign Detection with Semantic Attributes for Autonomous Driving

The paper introduces a multi‑modal traffic sign detection framework that fuses camera and LiDAR data using an Intensity‑Aware Deformable Fusion module to align retro‑reflective LiDAR cues with visual features. It also presents a dual motion‑model tracker to handle non‑linear perspective changes and a semantic attribute classification pipeline that estimates occlusion, readability, sign embeddedness, and road relevance. Evaluated on a dataset covering more than 60 countries and 2,500 hours of driving, the system achieves an Object Miss Ratio of 0.49% across 221,068 sequences, indicating strong global generalization for autonomous driving.

By Meda Lazar, Sourab Sridhar, Shashwata Gupta, Alexandra Tripcea, Varun Ravi, Senthil Yogamani