arXiv Computer Vision

StereoDiff: Stereo-Diffusion Synergy for Video Depth Estimation

arXiv AI
Jul 7

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.

By Baorui Ma, Jiahui Yang, Donglin Di, Xuancheng Zhang, Jianxun Cui, Hao Li, Yan Xie, Wei Chen
arXiv Computer Vision
Sep 22

Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation

The paper proposes a new sequence-to-sequence formulation for multi-view stereo (MVS) that jointly predicts 3D geometry for all input views using a global transformer architecture. It introduces ray‑map embeddings to inject camera parameters into image tokens and a unified global cost volume to capture 3D structure across all views. Experiments on public benchmarks demonstrate state‑of‑the‑art performance, outperforming both traditional MVS and feed‑forward reconstruction baselines.

By Aoxiang Fan, Corentin Dumery, Nicolas Talabot, Pascal Fua
Hugging Face Trending Papers
Jun 29

StereoGS: Sparse-View 3D Gaussian Splatting via Stereo Priors

3D Gaussian Splatting (3DGS) has achieved remarkable success in real-time novel view synthesis, yet it suffers from severe overfitting under sparse-view settings due to insufficient geometric constraints. While recent methods introduce monocular depth priors to mitigate this, they inherently struggle with scale ambiguity and cross-view inconsistency, leading to defective geometry.

arXiv Computer Vision
Oct 16

WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing

WHTMix replaces the global self‑attention stage in stereo transformers with a data‑independent Walsh‑Hadamard token mixer, achieving the same end‑point error on synthetic driving data while cutting model compute by 2.46× and single‑image inference latency by 2.65×. The log‑linear cost of the mixer is especially advantageous for high‑resolution stereo matching, as shown by a complexity analysis that links benefits to the ratio of sequence length to channel width. Additionally, a hybrid log‑disparity loss is introduced to up‑weight small‑disparity pixels, improving accuracy on distant objects without extra computational cost.

By Prathyush Sajith, Emadeldeen Hamdan, Ahmet Enis Cetin