arXiv Computer Vision
Sep 21

Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering

The paper introduces Adaptive World Memory 3D Foundation Model (AWM-3DFM), a memory‑centric 3D foundation model that scales to large‑scale robotic localization, reconstruction, and Gaussian rendering. It employs transformer‑based gated updates, test‑time temporal‑spatial regulation, and local submap organization to maintain persistent memory, accuracy, and consistency across long image sequences. A Gaussian reconstruction head unifies pose estimation, dense point‑cloud reconstruction, and photorealistic rendering, achieving superior trajectory accuracy, reconstruction completeness, and rendering quality on public benchmarks and diverse robotic datasets.

By Tianchen Deng, Guole Shen, Yilin Shen, Wenhua Wu, Yilin Fang, Ziqi Ma, Tianjun Zhang, Shenghai Yuan, Wolfram Burgard, Hesheng Wang
arXiv Computer Vision
Sep 15

Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping

Anchor3R is a streaming 3D reconstruction framework that predicts window-relative poses and local geometry in the current‑frame coordinate system, forming a dense relative‑pose graph for online pose updates and loop‑aware motion averaging. It improves long‑horizon pose accuracy and dense reconstruction quality on indoor, outdoor, driving, and RGB‑D benchmarks, and generalizes from 48‑frame training sequences to streams exceeding 10,000 frames while keeping GPU memory bounded. The method addresses issues of train‑test mismatch, early‑anchor bias, and accumulated drift found in previous streaming models.

By Peilin Tao, Chong Cheng, Yuansen Du, Caiwei Song, Zhengqing Chen, Xiaoyang Guo, Wei Yin, Weiqiang Ren, Qian Zhang, Hainan Cui, Shuhan Shen