arXiv Computer Vision

RAHF-Net: Range-Aware Heterogeneous Fusion for LiDAR-Assisted RGB Semantic Segmentation

arXiv Machine Learning
2d ago

RaSFNet: Ray-aligned and Scan-aware Fusion Network for LiDAR Semantic Segmentation

RaSFNet introduces a Ray-aligned and Scan-aware Fusion Network for LiDAR semantic segmentation, addressing limitations of projection-based methods by preserving geometric differences within each frustum and modeling spatial relationships across scanning regions. It employs a Ray-Aligned Geometric Distribution Encoding (RAGDE) module, a Scan-Topology-Aware Mamba (STAM) block, and a Range-Constrained Point-Frustum Fusion (RCPFF) mechanism to integrate point cloud geometry, LiDAR scanning characteristics, and range information. The network achieves competitive mIoU scores of 70.2% on SemanticKITTI and 77.7% on nuScenes validation sets.

By Chuang Chen
arXiv Computer Vision
Oct 2

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

Lang3DSeg introduces a point‑transformer backbone for open‑vocabulary, annotation‑free 3D LiDAR segmentation, trained from scratch without geometric pre‑training. It tackles noise from 2D‑to‑3D label projections by applying a class‑priority rule and truncating projected instances at depth gaps, thereby correcting depth‑ambiguity errors. The method achieves state‑of‑the‑art results on nuScenes (52.8 % mIoU) and SemanticKITTI (41.4 % mIoU) while operating in real‑time on a single LiDAR sweep.

By Cigdem Kokenoz, Amir Salarpour, Alkim Domeke, Christopher Salas, Pedram MohajerAnsari, Long Cheng, Mert D. Pes\'e, Bing Li
arXiv AI
Sep 25

SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

SARFusion introduces a scene-aware routing approach for camera‑LiDAR 3D object detection, decoupling object‑query decoding into separate camera, LiDAR, and fusion branches. By estimating a global scene reliability prior and incorporating object‑level evidence, each query is routed to the most suitable branch, reducing cross‑modal interference. The method achieves strong performance on the nuScenes test set (72.5 mAP, 74.4 NDS) and demonstrates robustness to sensor corruptions and environmental changes.

By Yuting Zhao, Ziyi Zheng, Shuxiao Li
Hugging Face Trending Papers
Sep 8

DXPR: Depth-Based Vision-LiDAR Cross-Modal Place Recognition Using Vision Foundation Models

DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.

arXiv Computer Vision
Oct 5

PatchScene: Patch-based Voxel Diffusion for Large-Scale Scene Completion

PatchScene is a diffusion-based framework that completes large-scale LiDAR scenes using a patch-based voxel diffusion paradigm, generating fine-grained geometry in localized 3D regions. It incorporates a confidence-guided spatio-temporal fusion mechanism to merge overlapping patches and adjacent frames, and introduces an Annular-Flow diffusion strategy that propagates high-fidelity information from near to far ranges. Experiments on SemanticKITTI show state-of-the-art performance, with the model trained on 20 m LiDAR ranges generalizing to 50 m scenes without retraining.

By Qingdong Xu, Jiajun Zhu, Shilin Zhu, Xinjing He, Chao Lu, Huanran Wang, Jiyao Zhang