arXiv Computer Vision By Lazar Milikic, Manthan Patel, Jonas Frey

VLD: Visual Learned Distance as an Interface for Reinforcement Learning Navigation

Read the original on arXiv Computer Vision →

The paper introduces Visual Learned Distance (VLD), a framework that separates perception from policy learning for image-goal navigation. VLD trains a self-supervised distance-to-goal predictor on thousands of hours of video, then uses a reinforcement learning policy trained in simulation with a learned noise model (GeoNoise) to mimic the predictor’s errors. At deployment, the policy uses VLD predictions zero‑shot, achieving high success rates in simulated environments and on a physical robot without retraining.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jun 30

WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL

arXiv:2602. 13977v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) promises to unlock capabilities beyond imitation learning for Vision--Language--Action (VLA) models, but its requirement for massive real-world interaction prevents direct deployment on physical robots.

By Zhennan Jiang, Shangqing Zhou, Yutong Jiang, Zefang Huang, Mingjie Wei, Yuhui Chen, Tianxing Zhou, Zhen Guo, Hao Lin, Quanlu Zhang, Yu Wang, Haoran Li, Chao Yu, Dongbin Zhao
arXiv Computer Vision
Sep 25

Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces

The paper introduces a compact visual navigation system that decomposes the task into three analytically‑computed geometric interfaces and three small learned modules: an egress predictor, a navigation predictor, and an endpoint‑pinned residual diffusion generator. Only 0.58 M of the 23 M parameters are trained on 44 k frames, achieving competitive success rates and the lowest collision rate among evaluated methods across 6 060 point‑goal episodes in 60 environments. The design allows further parameter reduction by replacing the frozen image encoder with a 0.54 M MobileNetV2, supports zero‑shot deployment on a Jetson Orin Nano UGV, and enables transparent failure analysis under sensor corruption.

By Edward Beng Wai Tan, Siew-Kei Lam
arXiv AI
Jul 24

Robostral Navigate

arXiv:2607. 20785v1 Announce Type: cross Abstract: Deploying navigation systems at scale requires a recipe that minimizes sensor assumptions, generalizes across robot embodiments, and trains efficiently.

By Arjun Majumdar, Avinash Sooriyarachchi, Benjamin Tibi, Chris Bamford, Elliot Chane-Sane, Guillaume Lample, Khyathi Raghavi Chandu, Ludovic Ho Fuh, Mathieu Poiree, Olivier Duchenne, Rosalie Millner, Srijan Mishra, Theo Cachet, Thomas Chabal
arXiv AI
6d ago

SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models

SimForcing is a framework that distills motion priors from simulation into real‑domain robot world models. It transfers motion knowledge via latent‑motion distillation and uses multi‑block simulation conditioning with dropout to guide predictions without relying on accurate simulation outputs. The jointly trained student produces both simulation conditions and real‑domain videos, achieving state‑of‑the‑art metrics on Bridge and demonstrating applicability across robot datasets, while also improving downstream policy learning when used to initialize vision‑language‑action models.

By Xiaodong Wang, Tianle Li, Chuanxin Song, Junliang Xie, Zhanmi Zhong, Suiying Wu, Peixi Peng