arXiv Computer Vision
5d ago

CalibSwitch: Observation-Driven Camera-LiDAR Extrinsic Recovery and Selective Maintenance for Multimodal Perception

CalibSwitch is an observation‑driven framework for Camera–LiDAR perception that separates absolute extrinsic recovery from selective state maintenance. It introduces a cross‑modal absolute extrinsic generator (CAEG) that recovers full SE(3) candidates from image–point observations without needing an initial transform, and a selective recurrent calibration policy (SRCP) that decides when to update the working geometry based on observation quality and temporal history. On the nuScenes dataset, CAEG achieves mean translation and rotation errors of 0.248 m and 5.884°, while SRCP reduces composite error to 1.46 with only 9.70 % candidate commitments, improving frozen‑detector mAP and NDS by 1.43 and 0.92 points respectively.

By Haifa Zhang, Yijing Wang, Zhiqiang Zuo
arXiv Computer Vision
Sep 3

TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views

TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.

By Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman, Yi Yang, Ignacio Rocco, Jeet Thakwani, Rishabh Kabra, Andrew Zisserman, Joao Carreira, Siyu Tang, Carl Doersch, Gabriel Brostow