The paper introduces Z3D, a method that leverages internal representations from 3D Foundation Models (3DFMs) to perform zero‑shot novel depth synthesis. By decoding hidden surfaces and applying latent diffusion on 3DFM representations, Z3D can estimate realistic depth maps for unseen views across multiple datasets. This demonstrates that 3DFMs capture extensive general knowledge about 3D scenes, enabling accurate reconstruction without additional training.
By Denis M. Akola, David F. Fouhey
The paper explores how 3D Foundation Models (3DFMs) like VGGT can be leveraged for zero‑shot depth synthesis. By decoding hidden surfaces from the models’ internal representations, the authors introduce Z3D, a method that uses latent diffusion on 3DFM representations to estimate pointmaps in unseen views. Experiments demonstrate that Z3D can generate realistic depth maps across multiple datasets.
arXiv:2609.01172v1 Announce Type: new
Abstract: Monocular depth estimation has long stood as a fundamental challenge in computer vision, enabling a wide range of applications including 3D reconstruct...
By Muxin Liu, Xiaoyang Lyu, Yang-Tian Sun, Yi-Hua Huang, Ziyi Yang, Peng Dai, Xiaojuan Qi
arXiv:2608.20788v1 Announce Type: new
Abstract: Deep learning-based Multi-View Stereo (MVS) has advanced significantly but often generalizes poorly to unseen scenes, particularly in occluded areas or...
By Byeonggwon Lee, Sanggi Lee, Siwoo Lee, Khang Truong Giang, Soohwan Song
arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.
By Baorui Ma, Jiahui Yang, Donglin Di, Xuancheng Zhang, Jianxun Cui, Hao Li, Yan Xie, Wei Chen
arXiv:2603.14528v3 Announce Type: replace
Abstract: In recent years, 3D visual foundation models, pioneered by pointmap-based approaches such as DUSt3R, have attracted a lot of interest, achieving im...
By Shuang Guo, Filbert Febryanto, Lei Sun, Luc Van Gool, Guillermo Gallego