arXiv Computer Vision By Manthan Patel, Jonas Frey, Mayank Mittal, Fan Yang, Alexander Hansson, Amir Bar, Cesar Cadena, Marco Hutter

DeFM: Learning Foundation Representations from Depth for Robotics

Read the original on arXiv Computer Vision →

DeFM is a self‑supervised foundation model trained solely on depth images for robotics. It uses a DINO‑style self‑distillation objective on 60 M curated depth images to learn geometric and semantic representations that generalize across environments, tasks, and sensors. The model incorporates a novel input normalization strategy for metric awareness, can be distilled into compact versions for resource‑constrained systems, and achieves state‑of‑the‑art performance on depth‑based classification, segmentation, navigation, locomotion, and manipulation benchmarks, with strong sim‑to‑real transfer.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jul 7

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv:2601. 22054v2 Announce Type: replace-cross Abstract: Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data.

By Baorui Ma, Jiahui Yang, Donglin Di, Xuancheng Zhang, Jianxun Cui, Hao Li, Yan Xie, Wei Chen
arXiv AI
Jul 10

Time-to-Collision Based Dynamic Obstacle Avoidance Using Pretrained Vision Models for Robots in Unstructured Environments

arXiv:2607. 07885v1 Announce Type: cross Abstract: Dynamic obstacle avoidance in unstructured outdoor environments remains a critical challenge for autonomous mobile robots, particularly when large-scale robot-specific training data and simulation-based policies are impractical.

By Erik Jagnandan, Mulugeta Haile, Gregory Barber, Pratik Chaudhari