arXiv Computer Vision

TriSAR-3D and PaintFusion: A Novel Trimodal LiDAR-RGB-Thermal Dataset and Method for 3D Person Detection in Search and Rescue

TriSAR-3D is a new trimodal dataset combining high‑resolution LiDAR, RGB, and thermal imagery to capture people in varied indoor and outdoor poses, including lying and partially occluded positions. The authors propose PaintFusion, a lightweight trimodal 3D detection pipeline that fuses PointPainting evidence with an MLP, achieving 65.4 AP@50 and outperforming LiDAR‑only, RGB+LiDAR, and other trimodal baselines while running faster (51.6 ms per frame). Experiments show that removing lying instances from training drastically reduces detection performance, highlighting the importance of dataset diversity for robust 3D person detection in search and rescue scenarios.

arXiv Computer Vision
5d ago

FastBEVFusion: Simple Multi-Modal Fusion for 3D Object Detection at 50 FPS

FastBEVFusion is a lightweight fusion system for real‑time 3D object detection that combines LiDAR and camera data without depth estimation. It projects modality‑specific features into semi‑aligned BEV spaces and fuses them with a dynamic cross‑attention module, achieving over 50 FPS on the nuScenes dataset. The method also demonstrates strong robustness to calibration errors.

By Tom Sanitz, Emre G\"ulsoylu, Simone Frintrop, Christian Wilms
arXiv Machine Learning
Jun 8

Does Appearance Help? A Systematic Study of Image-Based Re-Identification in Online 3D Multi-Pedestrian Tracking

arXiv:2606. 07233v1 Announce Type: cross Abstract: LiDAR-based 3D Multi-Object Tracking (MOT) typically relies solely on geometric information, which is often insufficient to distinguish between targets during prolonged occlusions or in crowded human-populated environments.

By Eduardo Borges, Lu\'is Garrote, Urbano J. Nunes
arXiv AI
Jun 11

Multi-View In-Cabin Monitoring System for Public Transport Vehicles

arXiv:2606. 11739v1 Announce Type: cross Abstract: We introduce a multi-view in-cabin monitoring dataset for public transportation with synchronized RGB and depth images from four inward-facing cameras and a rotating LiDAR covering the vehicle interior of a digitalized and partly automated German city bus.

By Evgeny Gorelik, Kenny Dean Karrow, Fikret Sivrikaya, Sahin Albayrak, Christian Baumann
arXiv AI
Sep 25

SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

SARFusion introduces a scene-aware routing approach for camera‑LiDAR 3D object detection, decoupling object‑query decoding into separate camera, LiDAR, and fusion branches. By estimating a global scene reliability prior and incorporating object‑level evidence, each query is routed to the most suitable branch, reducing cross‑modal interference. The method achieves strong performance on the nuScenes test set (72.5 mAP, 74.4 NDS) and demonstrates robustness to sensor corruptions and environmental changes.

By Yuting Zhao, Ziyi Zheng, Shuxiao Li
arXiv Computer Vision
Oct 22

AutoExpert: Automating 3D LiDAR Annotation from Expert-Crafted Guidelines

AutoExpert proposes a new benchmark for automating 3D LiDAR annotation using expert‑crafted guidelines, redefining evaluation protocols and re‑annotating nuScenes and PandaSet datasets. The pipeline combines 2D detection and segmentation in RGB images, lifts these detections into 3D with known sensor poses, and generates 3D cuboids, improving 3D detection mAP from 12.1 to 25.4 on the AutoExpert‑nuScenes benchmark.

By Yechi Ma, Wei Hua, Shu Kong
arXiv Computer Vision
Oct 9

TAP3D: Thermal-Assisted 3D Human Point Clouds

TAP3D is a new system that reconstructs dense 3D human point clouds from low‑cost thermal array sensors, avoiding the high cost, sparsity, and privacy issues of LiDAR, radar, and depth cameras. It uses a physics‑informed design with a forward thermal model, multi‑primitive estimation for self‑supervised depth recovery, and geometric perspective fusion to suppress interference and separate multiple people. The system, built on a single commodity sensor and evaluated on a 160K‑sample dataset, achieves high accuracy in downstream tasks such as fall detection, indoor tracking, and human mesh recovery.

By Xie Zhang, Chengxiao Li, Xuan Liu, Chenshu Wu
arXiv Computer Vision
Sep 18

Open-vocabulary 3D object detection with promptable segmentation

The paper introduces an open‑vocabulary 3D object detection pipeline that uses a promptable segmentation model (SAM3) to generate instance masks from six surround‑view cameras. These masks are converted into metric 3D boxes, achieving up to 0.413 mAP/0.555 NDS without any training when supervised box geometry is borrowed at inference. The approach also improves a supervised LiDAR‑only detector by 0.034 mAP through a camera‑witness rule, demonstrating that measurement precision, not 2D detection, limits performance.

By \"Omer Faruk Deniz, Mustafa Taha Ko\c{c}yi\u{g}it
arXiv AI
Jun 2

DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance

arXiv:2606. 01277v1 Announce Type: cross Abstract: Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encounters, specifically sudden pedestrian crossings.

By Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky, Jazi Eko Istiyanto, Jun Miura