← Back to all news
arXiv Computer Vision

Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction

Scal3R is a new method for online 3D reconstruction that addresses the failure of traditional models on long videos by decoupling per‑frame depth from global pose estimation. It reformulates reconstruction as a multi‑reference relative pose query, using lightweight learnable tokens (~1% of parameters) injected into a frozen backbone via asymmetric attention to query poses relative to multiple past keyframes. An online pose‑graph optimization with loop closure further suppresses drift, achieving convergence in 8 hours on a single GPU and reducing average absolute trajectory error by over 60% on KITTI while setting state‑of‑the‑art results on several benchmark datasets.

Related stories

arXiv Computer Vision
3d ago

Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping

Anchor3R is a streaming 3D reconstruction framework that predicts window-relative poses and local geometry in the current‑frame coordinate system, forming a dense relative‑pose graph for online pose updates and loop‑aware motion averaging. It improves long‑horizon pose accuracy and dense reconstruction quality on indoor, outdoor, driving, and RGB‑D benchmarks, and generalizes from 48‑frame training sequences to streams exceeding 10,000 frames while keeping GPU memory bounded. The method addresses issues of train‑test mismatch, early‑anchor bias, and accumulated drift found in previous streaming models.

By Peilin Tao, Chong Cheng, Yuansen Du, Caiwei Song, Zhengqing Chen, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Hainan Cui, Shuhan Shen
benchmarkssafety
More like this →
arXiv Computer Vision
3d ago

MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons

arXiv:2604.28130v4 Announce Type: replace Abstract: Recent methods for arbitrary-skeleton motion capture from monocular video follow a factorized pipeline, where a Video-to-Pose network predicts join...

By Kehong Gong, Zhengyu Wen, Dao Thien Phong, Mingxi Xu, Weixia He, Qi Wang, Ning Zhang, Zhengyu Li, Guanli Hou, Dongze Lian, Xiaoyu He, Mingyuan Zhang, Hanwang Zhang
More like this →
Hugging Face Trending Papers
Jun 29

Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes

Metric feed-forward 3D reconstruction for panoramic data remains under-explored due to the lack of large-scale panoramic RGB-D training data. We present Realsee3D, a hybrid dataset of 10K indoor scenes (1K real, 9K synthetic) with 299K panoramic viewpoints and precise metric annotations, and Argus, a feed-forward network trained on it for metric panoramic 3D reconstruction.

computer-visionbenchmarks
More like this →
arXiv Computer Vision
Aug 31

GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping

GeoFF3D is a new feed‑forward 3D reconstruction method designed for large‑scale UAV mapping. It uses a coordinate‑anchored model that predicts camera poses and dense point maps directly in a gravity‑aligned Z‑up metric frame, while a spatial large‑scale reconstruction framework (SLRF) partitions images into overlapping chunks, propagates shared‑view priors, and aggregates local reconstructions hierarchically. Across nine aerial mapping blocks, GeoFF3D achieves the best average reconstruction quality, improving F@5 from 0.829 to 0.877, and can reconstruct 2,000 images in about five minutes.

By Xiang Yang, Yongli Wang, Yunsheng Zhang
safety
More like this →
arXiv Computer Vision
Aug 25

ORBIT++: Benchmarking SfM in the Wild with 360{\deg} Video

arXiv:2608.22039v1 Announce Type: new Abstract: Structure-from-Motion (SfM) is a cornerstone of 3D perception, yet current methods often fail when applied to complex videos involving challenging came...

By Sara Sabour, Linyi Jin, Richard Tucker, Amir Hertz, Marcus Brubaker, Saurabh Saxena, Junhwa Hur, Andrea Tagliasacchi, Deqing Sun, David J. Fleet, Richard Szeliski, Noah Snavely
computer-visionbenchmarks
More like this →