arXiv Computer Vision

FlowMoDE: Coarse-to-fine Flow Matching for Detail-aware Sim-to-Real Monocular Depth Estimation

FlowMoDE introduces a coarse‑to‑fine flow‑matching framework for monocular depth estimation that balances efficiency and detail reconstruction. The method first decodes coarse depth conditioned on diffused features from a pre‑trained semantic encoder, then refines fine structural patterns with expanded decoding layers. Trained only on a synthetic indoor dataset, FlowMoDE achieves a 14.1% lower relative error and a 9.9% lower Chamfer distance compared to state‑of‑the‑art methods across five real‑world indoor and outdoor datasets, and demonstrates strong generalization to realistic robotic scenes.

arXiv Machine Learning
Sep 10

Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation

arXiv:2609.08084v1 Announce Type: cross Abstract: Monocular depth estimation is a ubiquitous yet highly ill-posed computer vision task, with downstream applications in scene reconstruction, computati...

By Igor Pavlovic, Thiemo Wandel, Anton Obukhov, Luca Bartolomei, Andrey Davydov, Fabio Tosi, Matteo Poggi, Sabine S\"usstrunk, Dengxin Dai
arXiv Computer Vision
Oct 16

ControlFlow3D: Distilling Multi-View Knowledge into Latent Flow Matching for Point Cloud Upsampling

ControlFlow3D is a framework that upsamples point clouds by distilling knowledge from pretrained foundation models into a lightweight generation network. It performs conditional flow matching in a latent space defined by a frozen 3D encoder, using unsupervised soft KMeans to cluster multi‑view image tokens and 3D latent tokens into shared prototypes that guide the flow trajectory. A Mamba‑based geometry decoder then maps latent features to dense coordinates with linear complexity, and the authors introduce ShapeNetPU, a 35K‑object multi‑modal benchmark 31 times larger than previous datasets.

By Yuang Liu, Zhi Zuo, Zhengkai Zhao, Lirui Zhang, Pan Gao, Hao Feng, Zhengzhe Liu
arXiv AI
Jul 7

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.

By Baorui Ma, Jiahui Yang, Donglin Di, Xuancheng Zhang, Jianxun Cui, Hao Li, Yan Xie, Wei Chen
arXiv Computer Vision
Oct 9

Learning Which Correspondences to Trust: Confidence-Weighted Event-Camera Localization in LiDAR Maps

The paper introduces CELL, a confidence-weighted event-camera localization method that learns per-correspondence confidence end-to-end using a differentiable probabilistic PnP. It reweights flow supervision, drives probabilistic correspondence selection at test time, and refines edge matching, while also proposing a partial-completion depth representation. Experiments on M3ED and DSEC show significant reductions in median translation and rotation errors compared to the LEAR baseline.

By Panagiotis Kiousis, Kuangyi Chen, Jun Zhang, Friedrich Fraundorfer
arXiv Computer Vision
Oct 2

Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Models

Dyna3 is a training‑free framework that extends the depth foundation model DA3 to perform 4D dynamic scene reconstruction without fine‑tuning. By leveraging DA3’s cross‑view features and a best‑match search, it distinguishes static surfaces from moving objects, and uses vision‑language models to generate semantic prompts for SAM 3 to achieve precise instance‑level segmentation. Experiments on four datasets show Dyna3 outperforms correspondence‑trained methods, improving dynamic object segmentation by +5.5 pp, speeding pose estimation 13×, and reducing memory usage 4–8×.

By Xinhao Xiang, Weiyang Li, Zhijie Zheng, Abhijeet Rastogi, Jiawei Zhang
arXiv AI
Aug 19

PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation

PXDepth is a monocular depth estimation model that separates global context modeling from pixel-level depth prediction. It uses a large-patch Vision Transformer to capture scene context and a pixel-space predictor with Context‑Modulated Pixel Transformer blocks to preserve high‑resolution spatial details. The approach maintains fine structures and sharp boundaries while achieving competitive global depth accuracy in zero‑shot benchmarks.

By Zhiyuan Yuan, Guanying Chen, Lingteng Qiu, Ruimao Zhang, Shuguang Cui, Xiaochun Cao
Hugging Face Trending Papers
Oct 13

OpenDepth: Repurposing Image Editing Priors for Robust Open-World Monocular Depth Estimation

OpenDepth repurposes Image-to-Image (I2I) editing priors to improve monocular depth estimation in open-world conditions. By aligning shallow features in a Diffusion Transformer and adding a joint RGB reconstruction task, the method decouples environmental style from geometry, enabling robust depth inference across varied lighting and weather. The approach achieves new state‑of‑the‑art performance on standard and extreme weather benchmarks, maintaining structural integrity in zero‑shot settings.