arXiv Computer Vision

PnP*: A certifiable solver for Perspective-n-Point

arXiv Computer Vision
1d ago

XM4D: 4D Reconstruction through Certifiable Geometric Optimization

XM4D is a new framework for accurate 4D reconstruction that separates camera motion estimation from non‑rigid deformation. Both stages are cast as structured quadratically constrained quadratic programs (QCQPs) with semidefinite programming (SDP) relaxations, enabling certifiable global optimality. The method uses GPU‑accelerated Burer‑Monteiro solvers, initializes dynamic Gaussian splatting for refinement, and achieves state‑of‑the‑art performance on seven benchmarks.

By Haoyu Han, Jack Benarroch Jedlicki, Jiahui Lei, Heng Yang
arXiv Computer Vision
Oct 12

Perspective-1-Ellipsoid: Formulation, Analysis and Solutions of the Camera Pose Estimation Problem from One Ellipse-Ellipsoid Correspondence

The paper introduces a new ellipsoid‑specific framework for camera pose estimation from a single ellipse‑ellipsoid correspondence. It shows that the problem can be reduced to either a position‑only or orientation‑only estimation, with the remaining unknowns solvable in closed form, and further to a single degree‑of‑freedom problem with an analytical pose solution. The authors illustrate the theory with visual examples, discuss practical aspects, and provide source code to aid efficient pose estimation.

By Vincent Gaudilli\`ere, Gilles Simon, Marie-Odile Berger
arXiv AI
Oct 31

Aligning Misaligned Benchmarks for Single-View Novel View Synthesis

The paper addresses the lack of standardized evaluation for single‑view novel view synthesis by highlighting the importance of aligning a method’s reference frame with the ground‑truth camera pose. It proposes using traditional 2D‑to‑2D and 2D‑to‑3D image matching to align 3D reconstructions and restricts evaluation to co‑visible regions where a correct ground truth exists. Experiments show that with proper alignment, 3D Gaussian‑based methods reach state‑of‑the‑art performance, and a simple baseline using a video generator and geometry estimator matches specialized novel‑view synthesis models without task‑specific training.

By Yang-Che Tseng, Erqun Dong, Jeong-gi Kwak, Gopal Sharma, Shakiba Kheradmand, Stephan Garbin, Hossam Isack, Kwang Moo Yi
arXiv Computer Vision
Oct 9

Learning Which Correspondences to Trust: Confidence-Weighted Event-Camera Localization in LiDAR Maps

The paper introduces CELL, a confidence-weighted event-camera localization method that learns per-correspondence confidence end-to-end using a differentiable probabilistic PnP. It reweights flow supervision, drives probabilistic correspondence selection at test time, and refines edge matching, while also proposing a partial-completion depth representation. Experiments on M3ED and DSEC show significant reductions in median translation and rotation errors compared to the LEAR baseline.

By Panagiotis Kiousis, Kuangyi Chen, Jun Zhang, Friedrich Fraundorfer
Hugging Face Trending Papers
Aug 5

Differential 6-DOF Pose Estimation with Provable First-Order Immunity to Camera Calibration Errors

Accurate six-degree-of-freedom (6-DOF) motion estimation is essential for robotic manipulation, autonomous systems, and structural displacement monitoring. Conventional 3D-2D methods estimate absolute camera poses independently at each time and recover platform motion through camera-to-platform extrinsics, making them sensitive to extrinsic calibration errors, especially for micromotion.

arXiv Computer Vision
Sep 4

Stable and Scalable Bundle Adjustment of Holistic 3D Structures

The paper introduces a unified bundle adjustment framework that jointly optimizes camera parameters, sparse 3D points, and richer geometric features such as lines, coplanarity, and parallelism. It classifies features into scalable ones with direct 2D measurements and higher‑order groups that can be treated as camera‑like entities, allowing group constraints and cross‑feature relations to be expressed via 2D reprojection errors. This approach preserves the sparsity of classical point‑based BA, maintains numerical stability, and achieves runtime comparable to point‑only BA while producing richer 3D structures and improved accuracy.

By Shaohui Liu, R\'emi Pautrat, Daniel Barath, Richard Hartley, Viktor Larsson, Marc Pollefeys