arXiv:2608.20788v1 Announce Type: new Abstract: Deep learning-based Multi-View Stereo (MVS) has advanced significantly but often generalizes poorly to unseen scenes, particularly in occluded areas or...
The paper introduces Epipolar Distillation (EpiDistill), a method that transfers scale‑aware geometric priors from multi‑view models to monocular depth foundation models using Rectified Stereo Tokens. By preserving epipolar attention patterns, the single‑view model maintains geometric consistency without needing multi‑view inputs during inference. Experiments show significant improvements in zero‑shot metric depth estimation on challenging datasets such as ETH3D and DIODE, and the approach consistently boosts performance of state‑of‑the‑art ViT‑based models like UniDepthV2 and DepthPro.
arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.
DeFM is a self‑supervised foundation model trained solely on depth images for robotics. It uses a DINO‑style self‑distillation objective on 60 M curated depth images to learn geometric and semantic representations that generalize across environments, tasks, and sensors. The model incorporates a novel input normalization strategy for metric awareness, can be distilled into compact versions for resource‑constrained systems, and achieves state‑of‑the‑art performance on depth‑based classification, segmentation, navigation, locomotion, and manipulation benchmarks, with strong sim‑to‑real transfer.
The paper introduces Z3D, a method that leverages internal representations from 3D Foundation Models (3DFMs) to perform zero‑shot novel depth synthesis. By decoding hidden surfaces and applying latent diffusion on 3DFM representations, Z3D can estimate realistic depth maps for unseen views across multiple datasets. This demonstrates that 3DFMs capture extensive general knowledge about 3D scenes, enabling accurate reconstruction without additional training.
FounRef is a training‑free method that refines frozen monocular foundation priors into dense metric depth by aligning them with sparse metric anchors. It validates anchors against the prior’s predictions, rejects misaligned ones, and applies a structure‑preserving solver to correct depth globally and locally while preserving fine geometry. The approach works out of the box on unseen cameras and scenes, achieving up to 24% lower depth error, 92% lower surface‑normal noise, and nearly 15× faster inference than a leading depth‑completion network.
Dual-pixel (DP) imaging enables metric depth estimation from a single camera using sub-aperture disparity. However, the extremely small effective baseline limits disparity observability, leading to structural degradation and depth failure in textureless, low-contrast, or downsampled regions.
The paper explores how 3D Foundation Models (3DFMs) like VGGT can be leveraged for zero‑shot depth synthesis. By decoding hidden surfaces from the models’ internal representations, the authors introduce Z3D, a method that uses latent diffusion on 3DFM representations to estimate pointmaps in unseen views. Experiments demonstrate that Z3D can generate realistic depth maps across multiple datasets.
MDE-VIO integrates learned depth priors into the VINS-Mono optimization backend to improve visual‑inertial odometry in low‑texture environments. The framework enforces affine‑invariant depth consistency and pairwise ordinal constraints while filtering unstable artifacts with variance‑based gating, keeping computation within edge‑device limits. Experiments on TartanGround and M3ED datasets show the method prevents divergence and reduces Absolute Trajectory Error by up to 28.3%.
arXiv:2609.22896v1 Announce Type: new Abstract: Autonomous vehicles operating in open-world scenarios are inevitably confronted with previously unknown objects, such as exotic animals or loose cargo....
arXiv:2608.22821v1 Announce Type: new Abstract: We present SiZeUp, a fast and scalable approach for constructing large-scale 3D urban proxy models directly from calibrated oblique aerial imagery. Our...
arXiv:2607. 12433v1 Announce Type: cross Abstract: Diffusion models have recently become the dominant paradigm for monocular depth estimation (MDE).