arXiv Computer Vision

OmniPoint: Universal Monocular Metric Pointcloud from Any Camera

arXiv Computer Vision
Sep 3

Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth

The paper introduces Epipolar Distillation (EpiDistill), a method that transfers scale‑aware geometric priors from multi‑view models to monocular depth foundation models using Rectified Stereo Tokens. By preserving epipolar attention patterns, the single‑view model maintains geometric consistency without needing multi‑view inputs during inference. Experiments show significant improvements in zero‑shot metric depth estimation on challenging datasets such as ETH3D and DIODE, and the approach consistently boosts performance of state‑of‑the‑art ViT‑based models like UniDepthV2 and DepthPro.

By Jung-Hee Kim, Xiaoming Liu
arXiv AI
Jul 7

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.

By Baorui Ma, Jiahui Yang, Donglin Di, Xuancheng Zhang, Jianxun Cui, Hao Li, Yan Xie, Wei Chen
arXiv Computer Vision
Oct 21

PURE: Refining Feed-forward 3D Reconstruction with Unlabeled Post-training

PURE is an unlabeled post‑training refinement framework that enhances feed‑forward 3D reconstruction models by improving depth and camera estimation without ground‑truth supervision. It distills structural knowledge from state‑of‑the‑art 2D priors into 4D architectures, using relative depth constraints, affine‑invariant geometry distillation, and pose refinement via feature correspondences. Experiments on synthetic and real‑world dynamic benchmarks show consistent improvements across multiple state‑of‑the‑art models, effectively mitigating domain shifts and unlocking their architectural limits in challenging in‑the‑wild scenes.

By Yaolong Zhu, Peng Li, Jiahao Lu, Chengfeng Zhao, Mengfei Li, Chao Wang, Wenyue Chen, Zekai Gu, Chengwei Ren, Ronggang Wang, Yuan Liu
arXiv Computer Vision
Oct 23

OmniRay: Camera-Agnostic Monocular 3D Reconstruction with Composite Ray Fields

OmniRay is a feed‑forward model for monocular 3D reconstruction that works without assuming a pinhole camera. It predicts a ray direction and a scale‑free radial distance for each pixel using a composite Ray Module consisting of a monotone radial base, a spherical‑harmonic residual, and a free‑form residual. Experiments across various camera types show that OmniRay achieves state‑of‑the‑art performance in camera‑agnostic monocular 3D reconstruction.

By Namitha Guruprasad, Abhay Yadav, Cheng Peng, Rama Chellappa, Anand Bhattad
Hugging Face Trending Papers
Jun 29

Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes

Metric feed-forward 3D reconstruction for panoramic data remains under-explored due to the lack of large-scale panoramic RGB-D training data. We present Realsee3D, a hybrid dataset of 10K indoor scenes (1K real, 9K synthetic) with 299K panoramic viewpoints and precise metric annotations, and Argus, a feed-forward network trained on it for metric panoramic 3D reconstruction.