arXiv Computer Vision By Ernesto Lozano, Alberto Jaenal, Javier Civera

VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues

Read the original on arXiv Computer Vision →

VI3 is a model‑agnostic framework that grounds pretrained 3D foundation models (3DFMs) by using inertial measurement unit (IMU) data to provide metric scale. It initializes and preintegrates IMU readings to create a metric motion reference, which is then used to recover the scale of 3DFM outputs. The approach includes adaptable anchoring strategies for different 3DFM architectures and demonstrates scale recovery on synthetic and real aerial datasets without ground‑truth supervision.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 9

Pumpire: Unified Benchmark for Metric Distance Estimation

Pumpire introduces a unified benchmark for assessing metric point‑pair distance estimation in both image‑ and video‑level 3D foundation models, with or without depth priors. The benchmark uses a large, diverse dataset (pumpire‑6k) of 100 real‑world scenes, each annotated with physically measured point‑pair distances across 64 frames, totaling 6,400 frames. An evaluation protocol is provided that directly measures point‑to‑point distance errors, enabling cross‑setting comparison across 29 baseline 3D models.

By Siyu Chen, Zehan Wang, Jiayang Xu, Yihan Wu, Jialei Wang, Junming Chen, Ziang Zhang, Yutong Ying, Zhou Zhao
arXiv Computer Vision
Sep 25

FounRef: Robust, Structure-Preserving, and Fast Metric Refinement of Frozen Monocular Foundation Priors with Sparse Anchors

FounRef is a training‑free method that refines frozen monocular foundation priors into dense metric depth by aligning them with sparse metric anchors. It validates anchors against the prior’s predictions, rejects misaligned ones, and applies a structure‑preserving solver to correct depth globally and locally while preserving fine geometry. The approach works out of the box on unseen cameras and scenes, achieving up to 24% lower depth error, 92% lower surface‑normal noise, and nearly 15× faster inference than a leading depth‑completion network.

By Dan Halperin, Mirko M\"ahlisch
arXiv AI
Jul 7

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.

By Baorui Ma, Jiahui Yang, Donglin Di, Xuancheng Zhang, Jianxun Cui, Hao Li, Yan Xie, Wei Chen