arXiv Computer Vision By Haifa Zhang, Yijing Wang, Zhiqiang Zuo

CalibSwitch: Observation-Driven Camera-LiDAR Extrinsic Recovery and Selective Maintenance for Multimodal Perception

Read the original on arXiv Computer Vision →

CalibSwitch is an observation‑driven framework for Camera–LiDAR perception that separates absolute extrinsic recovery from selective state maintenance. It introduces a cross‑modal absolute extrinsic generator (CAEG) that recovers full SE(3) candidates from image–point observations without needing an initial transform, and a selective recurrent calibration policy (SRCP) that decides when to update the working geometry based on observation quality and temporal history. On the nuScenes dataset, CAEG achieves mean translation and rotation errors of 0.248 m and 5.884°, while SRCP reduces composite error to 1.46 with only 9.70 % candidate commitments, improving frozen‑detector mAP and NDS by 1.43 and 0.92 points respectively.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 25

Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces

The paper introduces a compact visual navigation system that decomposes the task into three analytically‑computed geometric interfaces and three small learned modules: an egress predictor, a navigation predictor, and an endpoint‑pinned residual diffusion generator. Only 0.58 M of the 23 M parameters are trained on 44 k frames, achieving competitive success rates and the lowest collision rate among evaluated methods across 6 060 point‑goal episodes in 60 environments. The design allows further parameter reduction by replacing the frozen image encoder with a 0.54 M MobileNetV2, supports zero‑shot deployment on a Jetson Orin Nano UGV, and enables transparent failure analysis under sensor corruption.

By Edward Beng Wai Tan, Siew-Kei Lam
arXiv Computer Vision
1d ago

Can BEV Perception Gracefully Degrade under Sensor Failures?

The paper introduces Grace-BEV, a lightweight framework that enhances the robustness of Lift‑Splat‑Shoot (LSS) based bird’s‑eye view (BEV) perception models against sensor corruptions. Grace‑BEV operates in aligned BEV space, combining a LiDAR‑guided image‑BEV expert with a LiDAR‑independent visual expert, and uses a TrustGate Router and FailSafe Fusion Block to mix and recalibrate their outputs. Experiments on nuScenes-R and nuScenes-C show that Grace‑BEV maintains strong performance under diverse corruptions, recovers up to 34.7 mAP when LiDAR is lost, and even improves clean accuracy by up to 1.4 mAP with only 1.2M additional parameters.

By Haifa Zhang, Yijing Wang, Zhiqiang Zuo
arXiv Computer Vision
Sep 25

M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis

M3GD introduces a multimodal representation that fuses pre‑trained 2D image and 3D LiDAR foundation models for robotic novel view synthesis, avoiding the need for a separate cross‑modal translator. By projecting LiDAR onto the image latent grid and injecting the resulting geometry‑aware packets via a lightweight residual adapter, the method enhances both RGB and depth synthesis on the GrandTour dataset compared to an image‑only baseline. Ablation studies confirm that pixel‑aligned LiDAR content drives the performance gains, and real‑world deployment on a ground robot demonstrates a tunable quality–cost trade‑off.

By Yang Zhou, Jiuhong Xiao, Shizhao Ye, Long Quang, Carlos Nieto-Granda, Giuseppe Loianno
arXiv AI
Aug 21

CVSD-Reg: Cross-Modal Visual Semantic Prior Distillation for Robust LiDAR Registration

arXiv:2608. 19536v1 Announce Type: cross Abstract: Learning-based global point cloud registration has achieved remarkable progress, yet its reliance on geometric representations makes existing methods sensitive to variations in point density, scan pattern, viewpoint, and sensor characteristics.

By Eunsoo Im, Junghun Suh, Gyeonggwan Lee, Seunghwan Hong