arXiv Computer Vision

Learning Global Camera Poses from Noisy View-Graphs for Structure from Motion

Hugging Face Trending Papers
Jun 29

Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes

Metric feed-forward 3D reconstruction for panoramic data remains under-explored due to the lack of large-scale panoramic RGB-D training data. We present Realsee3D, a hybrid dataset of 10K indoor scenes (1K real, 9K synthetic) with 299K panoramic viewpoints and precise metric annotations, and Argus, a feed-forward network trained on it for metric panoramic 3D reconstruction.

arXiv Computer Vision
Sep 4

Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction

Scal3R is a new method for online 3D reconstruction that addresses the failure of traditional models on long videos by decoupling per‑frame depth from global pose estimation. It reformulates reconstruction as a multi‑reference relative pose query, using lightweight learnable tokens (~1% of parameters) injected into a frozen backbone via asymmetric attention to query poses relative to multiple past keyframes. An online pose‑graph optimization with loop closure further suppresses drift, achieving convergence in 8 hours on a single GPU and reducing average absolute trajectory error by over 60% on KITTI while setting state‑of‑the‑art results on several benchmark datasets.

By Chin-Yang Lin, Yang-Che Sun, Cheng Sun, Fu-En Yang, Min-Hung Chen, Yen-Yu Lin, Wei-Chen Chiu, Yu-Lun Liu
arXiv Computer Vision
Aug 28

A Geometry-Driven, Framework-Agnostic Optimization for Object Pose Estimation

The paper proposes a data‑centric optimization for object pose estimation that uses a physically grounded rotation representation based on principal axes alignment. By aligning an object's coordinate system with its inertial principal axes, the method achieves inherent stability, symmetry‑aware canonicalization, and framework agnosticism, allowing it to be applied at the dataset level without modifying existing networks. Experiments on category‑level and instance‑level models show consistent accuracy improvements while preserving baseline network integrity.

By Wei Chen, Tao Zhen, Zhongchen Shi, Jing Zhang, Liang Xie, Erwei Yin
Hugging Face Trending Papers
Jun 24

MVTrack4Gen: Multi-View Point Tracking as Geometric Supervision for 4D Video Generation

Synthesizing a novel-view video from a monocular reference video along a target camera trajectory requires both geometric consistency and motion fidelity with respect to the reference video. Existing methods based on explicit 3D representations are limited by the accuracy of off-the-shelf reconstruction modules, which often produce inaccurate geometry for dynamic objects in monocular videos.

arXiv Computer Vision
Sep 7

Object Concepts Emerge from Motion

The paper introduces a biologically inspired framework that learns object‑centric visual representations from raw videos without human annotations or camera calibration. By using motion boundaries detected via optical flow and clustering to create pseudo‑instance masks, the method supervises a single‑image encoder with pixel‑level pairwise metric learning. Training on 195 million pseudo‑labeled frames and expanding to 421 million frames through Motion‑Verified Self‑Training, the approach yields Swin‑based encoders that outperform or match supervised and self‑supervised baselines on tasks such as monocular depth estimation, 3D object detection, 3D occupancy prediction, and end‑to‑end planning.

By Boshi Li, Xiaohui Wang, Xiaoyang Wu, Zhichao Li, Ya Yang, Naiyan Wang
arXiv Computer Vision
Sep 1

Ground-to-Satellite Localization in Unconstrained Image Collections for 3D Scene Reconstruction

arXiv:2608.29211v1 Announce Type: new Abstract: Ground image localization with respect to satellite imagery is a key enabler for metrically-accurate, geo-localized 3D scene reconstruction from uncons...

By Angel Daruna, Ben Southall, Niluthpol Chowdhury Mithun, Kshitij Minhas, Nicholas Meegan, Qiao Wang, Bogdan Matei, Supun Samarasekera, Rakesh Kumar
arXiv Computer Vision
3d ago

MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons

arXiv:2604.28130v4 Announce Type: replace Abstract: Recent methods for arbitrary-skeleton motion capture from monocular video follow a factorized pipeline, where a Video-to-Pose network predicts join...

By Kehong Gong, Zhengyu Wen, Dao Thien Phong, Mingxi Xu, Weixia He, Qi Wang, Ning Zhang, Zhengyu Li, Guanli Hou, Dongze Lian, Xiaoyu He, Mingyuan Zhang, Hanwang Zhang