Point2Pose is a model‑free method for causal 6D pose tracking of multiple rigid objects using monocular RGB‑D video. It starts from sparse image points and employs a 2D point tracker to maintain long‑range correspondences, allowing instant recovery after complete occlusion. The system also incrementally builds an online Truncated Signed Distance Function (TSDF) representation of the tracked objects and introduces a new multi‑object tracking dataset with motion‑capture ground truth.
By Tzu-Yuan Lin, Ho Jae Lee, Kevin Doherty, Yonghyeon Lee, Sangbae Kim
arXiv:2610.34845v1 Announce Type: new
Abstract: Recent multi-view Transformers (e.g., DUSt3R and VGGT) have advanced 3D reconstruction by scaling training data and model capacity from two views to ma...
By Yihang Chen, Bin Tan, Yujun Shen, Yinghao Xu, Nan Xue
The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that replaces the traditional pairwise‑then‑global pipeline. It employs a foundation‑then‑refinement paradigm, using visual geometry foundation models to directly recover metrically consistent global poses and then refining them with voxelized spatial hashing and IRLS‑based bundle adjustment. Experiments on indoor, object‑centric, and outdoor datasets demonstrate superior registration accuracy and computational efficiency without any training.
By Haobo Jiang, Liang Yu, Jianmin Zheng
arXiv:2610.35361v1 Announce Type: new
Abstract: 3D Gaussian Splatting (3DGS) has become a promising representation for real-time novel view synthesis and 3D scene reconstruction. For practical deploy...
By Xiaohan Lu, Jiaqi Zhang, Weijia Jiang, Siwei Ma
arXiv:2607.09985v2 Announce Type: replace
Abstract: Object pose estimation is a fundamental problem in 3D vision. Although recent state-of-the-art approaches achieve strong performance, generalizatio...
By Yang You, Yi Du, Cole Harrison, Leonidas Guibas
Track-Free Dense Structure from Motion (TFD‑SfM) is a new approach that jointly optimizes camera extrinsics, focal lengths, and dense 3D geometry from a strict cold start, without relying on precise metric initialization or known intrinsics. It replaces rigid track-building with soft, probabilistic decisions by modeling each pixel match as a 3D Gaussian whose variance is learned, allowing unreliable matches to contribute minimally and smoothing the optimization landscape. Using a kinematic relative‑pose parameterization and a dual‑hypothesis mechanism, TFD‑SfM achieves competitive or superior results on datasets such as DTU, Mip‑NeRF 360, ETH3D, and IMC2021, recovering accurate camera poses, intrinsics, and dense geometry from unordered, uncalibrated image collections.
By Pak Hong Chui, Hector Andrade-Loarca, Daniel Cremers
arXiv:2605.13018v2 Announce Type: replace
Abstract: Object-centric scene understanding is a fundamental challenge in computer vision. Existing approaches often rely on multi-stage pipelines that firs...
By Yi Du, Yang You, Xiang Wan, Leonidas Guibas
GenIA is a framework that aligns generative 3D foundation models with test‑time observations, improving pose estimation and reconstruction from monocular, multi‑view, and dynamic inputs. It derives translation and scale from geometry, retains learned rotation priors, and aligns appearance using visibility‑biased attention, cross‑observation fusion, and differentiable rendering guidance during denoising. An optional post‑denoising refinement further adapts appearance latents and object placement, and the method also supports externally supplied geometry for dynamic objects, achieving better results than recent optimization‑based and image‑to‑3D methods on synthetic and real benchmarks.
By Stefano Esposito, Naama Pearl, Polina Karpikova, Samuel Rota Bul\`o, Lorenzo Porzi, Peter Kontschieder, Andreas Geiger, Jonathon Luiten
The paper introduces PointVGGT, a zero‑shot framework for multiview RGB‑D point cloud registration that avoids pairwise estimation by using a foundation‑then‑refinement paradigm. In the foundation stage, it recovers metrically consistent global poses by grounding scale‑ambiguous predictions from visual geometry foundation models against metric depth. The refinement stage employs voxelized spatial hashing and IRLS‑based bundle adjustment to efficiently refine poses, achieving high accuracy and computational efficiency across indoor, object‑centric, and outdoor datasets.
arXiv:2609.23796v2 Announce Type: replace
Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open ch...
By Yang-Tian Sun, Tianjia Liu, Zehuan Huang, Yi-Hua Huang, Xiaoyang Lyu, Ziyi Yang, Zi-Xin Zou, Yuan-Chen Guo, Yan-Pei Cao, Xiaojuan Qi
arXiv:2609.24487v1 Announce Type: new
Abstract: In this work, we present a method for shape reconstruction and tracking from video via agentic analysis-by-synthesis. Unlike prior methods which first...
By Kirill Mazur, Nikita Karaev, Matthew Chang, Jitendra Malik, Nur Muhammad "Mahi'' Shafiullah
arXiv:2609.23796v1 Announce Type: new
Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challe...
By Yang-Tian Sun, Tianjia Liu, Zehuan Huang, Yi-Hua Huang, Xiaoyang Lyu, Ziyi Yang, Zi-Xin Zou, Yuan-Chen Guo, Yan-Pei Cao, Xiaojuan Qi