arXiv Computer Vision
Aug 27

Point2Pose: Occlusion-Recovering 6D Pose Tracking and 3D Reconstruction for Multiple Unknown Objects Via 2D Point Trackers

Point2Pose is a model‑free method for causal 6D pose tracking of multiple rigid objects using monocular RGB‑D video. It starts from sparse image points and employs a 2D point tracker to maintain long‑range correspondences, allowing instant recovery after complete occlusion. The system also incrementally builds an online Truncated Signed Distance Function (TSDF) representation of the tracked objects and introduces a new multi‑object tracking dataset with motion‑capture ground truth.

By Tzu-Yuan Lin, Ho Jae Lee, Kevin Doherty, Yonghyeon Lee, Sangbae Kim
arXiv Computer Vision
Oct 9

PointVGGT: Zero-Shot Multiview RGB-D Point Cloud Registration with Visual Geometry Foundation Priors

The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that replaces the traditional pairwise‑then‑global pipeline. It employs a foundation‑then‑refinement paradigm, using visual geometry foundation models to directly recover metrically consistent global poses and then refining them with voxelized spatial hashing and IRLS‑based bundle adjustment. Experiments on indoor, object‑centric, and outdoor datasets demonstrate superior registration accuracy and computational efficiency without any training.

By Haobo Jiang, Liang Yu, Jianmin Zheng
arXiv Computer Vision
6d ago

Track-Free Dense Structure from Motion

Track-Free Dense Structure from Motion (TFD‑SfM) is a new approach that jointly optimizes camera extrinsics, focal lengths, and dense 3D geometry from a strict cold start, without relying on precise metric initialization or known intrinsics. It replaces rigid track-building with soft, probabilistic decisions by modeling each pixel match as a 3D Gaussian whose variance is learned, allowing unreliable matches to contribute minimally and smoothing the optimization landscape. Using a kinematic relative‑pose parameterization and a dual‑hypothesis mechanism, TFD‑SfM achieves competitive or superior results on datasets such as DTU, Mip‑NeRF 360, ETH3D, and IMC2021, recovering accurate camera poses, intrinsics, and dense geometry from unordered, uncalibrated image collections.

By Pak Hong Chui, Hector Andrade-Loarca, Daniel Cremers