arXiv AI
Jun 4
DVGT: Driving Visual Geometry Transformer
arXiv:2512. 16919v2 Announce Type: replace-cross Abstract: Perceiving and reconstructing 3D scene geometry from visual inputs is crucial for autonomous driving.
XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration
XCalib is an unsupervised dense registration framework that aligns thermal and visible video streams by optimizing virtual pinhole camera parameters and predicted monocular depth, thereby restricting spatial displacements to physically valid projection geometries. It introduces a novel registration paradigm using camera parameterization as an implicit regularizer, a robust Normalized Edges Correlation (NEC) metric for cross‑spectral alignment, and demonstrates superior temporal stability and alignment accuracy on public ADAS datasets compared to unconstrained dense flow baselines.
Related stories
arXiv Computer Vision
Aug 28
DPA-I2P: Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration in Autonomous Driving
The paper introduces DPA-I2P, a depth-guided projective alignment method for image-to-point-cloud registration in autonomous driving. It employs Ray-Conditioned Metric Depth Encoding and Projection-Consistent Vision Lifting to align depth and visual cues geometrically, and uses Cross-Modal Query Pruning to enhance matching stability. Experiments on KITTI and nuScenes show significant reductions in rotation and translation errors compared to existing implicit baselines.
Hugging Face Trending Papers
Sep 8
DXPR: Depth-Based Vision-LiDAR Cross-Modal Place Recognition Using Vision Foundation Models
DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.
arXiv Computer Vision
Sep 1
MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation
arXiv:2608.30521v1 Announce Type: new Abstract: Conventional algebraic triangulation solves 3D human pose estimation (HPE) from multi-view 2D keypoints. The typical approach, decoding 2D keypoints fr...
Hugging Face Trending Papers
Aug 27
DPA-I2P: Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration in Autonomous Driving
The paper introduces DPA-I2P, a depth‑guided projective alignment method for image‑to‑point‑cloud registration in autonomous driving. It employs Ray‑Conditioned Metric Depth Encoding and Projection‑Consistent Vision Lifting to align depth and visual cues geometrically, and uses Cross‑Modal Query Pruning to filter unreliable matches during refinement. Experiments on KITTI and nuScenes show significant improvements, reducing rotation and translation errors by up to 55.6% compared to existing implicit baselines.
arXiv Computer Vision
Sep 1
Geometry-Grounded Unified 3D Perception for Autonomous Driving
arXiv:2608.13147v2 Announce Type: replace Abstract: Camera-based autonomous driving perception requires a shared representation that preserves metric 3D structure across synchronized multi-camera str...
arXiv Computer Vision
Sep 14
Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videos
arXiv:2603.12064v3 Announce Type: replace Abstract: We address the challenging problem of dense dynamic scene reconstruction and camera pose estimation from multiple freely moving cameras -- a settin...
arXiv Computer Vision
Sep 3
TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views
TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.
arXiv AI
Jul 13
Single-Frame Point-Pixel Registration via Supervised Cross-Modal Feature Matching
arXiv:2506. 22784v2 Announce Type: replace-cross Abstract: Point-pixel registration between LiDAR point clouds and camera images is a fundamental yet challenging task in autonomous driving and robotic perception.
arXiv Computer Vision
Sep 14
DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers
DRS‑VPT is a feed‑forward transformer that performs image‑to‑scan registration by predicting the scan pose, point maps, and a coarse‑to‑fine feature pyramid for direct reprojective alignment. It unifies tasks like camera‑LiDAR calibration and indoor camera‑to‑map relocalization, achieving state‑of‑the‑art results in autonomous driving and competitive performance indoors without map‑specific training. The model also learns complex scan‑to‑image projection behaviors, such as occlusion of back‑facing points.
arXiv Computer Vision
Sep 10
OmniPoint: Universal Monocular Metric Pointcloud from Any Camera
arXiv:2609.09394v1 Announce Type: new Abstract: Recovering metric 3D geometry from monocular images is a fundamental computer vision task, yet current methods remain heavily fragmented by fixed camer...
arXiv AI
Jun 10
Generalized-CVO: Fast and Correspondence-Free Local Point Cloud Registration with Second Order Riemannian Optimization
arXiv:2606. 10019v1 Announce Type: cross Abstract: We propose a fast and correspondence-free local point cloud registration method that leverages geometric surface structure and reproducing kernel Hilbert space (RKHS) embeddings.