← Back to all news
arXiv Computer Vision By Chin-Yang Lin, Yang-Che Sun, Cheng Sun, Fu-En Yang, Min-Hung Chen, Yen-Yu Lin, Wei-Chen Chiu, Yu-Lun Liu

Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction

Read the original on arXiv Computer Vision →

Scal3R is a new method for online 3D reconstruction that addresses the failure of traditional models on long videos by decoupling per‑frame depth from global pose estimation. It reformulates reconstruction as a multi‑reference relative pose query, using lightweight learnable tokens (~1% of parameters) injected into a frozen backbone via asymmetric attention to query poses relative to multiple past keyframes. An online pose‑graph optimization with loop closure further suppresses drift, achieving convergence in 8 hours on a single GPU and reducing average absolute trajectory error by over 60% on KITTI while setting state‑of‑the‑art results on several benchmark datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Sep 15

Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping

Anchor3R is a streaming 3D reconstruction framework that predicts window-relative poses and local geometry in the current‑frame coordinate system, forming a dense relative‑pose graph for online pose updates and loop‑aware motion averaging. It improves long‑horizon pose accuracy and dense reconstruction quality on indoor, outdoor, driving, and RGB‑D benchmarks, and generalizes from 48‑frame training sequences to streams exceeding 10,000 frames while keeping GPU memory bounded. The method addresses issues of train‑test mismatch, early‑anchor bias, and accumulated drift found in previous streaming models.

By Peilin Tao, Chong Cheng, Yuansen Du, Caiwei Song, Zhengqing Chen, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Hainan Cui, Shuhan Shen
benchmarkssafety
More like this →
arXiv Computer Vision
Oct 23

HiP3R: Hierarchical Pose Graphs for Long-Horizon 3D Reconstruction

HiP3R introduces a hierarchical pose graph approach for long‑horizon 3D reconstruction, addressing the trade‑off between chunk‑level and frame‑level optimization. It first builds a robust chunk‑level Sim(3) graph to set the global layout and scale, then fixes this layout while estimating a single SE(3) camera pose per frame to merge overlapping predictions into a unified trajectory. Experiments on multiple benchmarks show that HiP3R improves camera trajectories and 3D reconstruction quality for both chunk‑based and streaming backends without extra training.

By Zunnan Xu, Shangchen Zhou, Yihang Luo, Chen Change Loy
fine-tuningbenchmarks
More like this →
arXiv Computer Vision
Sep 15

MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons

arXiv:2604.28130v4 Announce Type: replace Abstract: Recent methods for arbitrary-skeleton motion capture from monocular video follow a factorized pipeline, where a Video-to-Pose network predicts join...

By Kehong Gong, Zhengyu Wen, Dao Thien Phong, Mingxi Xu, Weixia He, Qi Wang, Ning Zhang, Zhengyu Li, Guanli Hou, Dongze Lian, Xiaoyu He, Mingyuan Zhang, Hanwang Zhang
More like this →