arXiv AI

ZeST: A VLM-based Zero-Shot Traversability Navigation for Unknown Environments

ZeST is a zero‑shot traversability navigation system that uses a vision‑language model (VLM) to generate stochastic measurements, which are fused into an uncertainty‑aware posterior. By avoiding real‑world data collection, ZeST offers a cost‑effective, scalable solution for predicting terrain traversability. Experiments in indoor and outdoor settings show ZeST achieving 90–100% success rates, outperforming baselines that top 60%.

Hugging Face Trending Papers
Jul 22

NavVerse: Benchmarking Indoor-to-Outdoor Embodied Navigation in Continuous Robot Simulation

Robots deployed in delivery, campus, and emergency-response settings often need to navigate from buildings to streets within a single continuous episode. Existing benchmarks usually evaluate indoor and outdoor navigation separately, and many abstract away robot execution, leaving exit finding, boundary traversal, adaptation, and kinodynamic failures underexplored.

arXiv AI
Jun 15

Schr\"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation

arXiv:2512. 21201v3 Announce Type: replace-cross Abstract: Zero-shot object navigation (ZSON) requires robots to find target objects in unseen environments without task-specific fine-tuning or pre-built maps, a key capability for general-purpose service robots.

By Yu He, Da Huang, Zhenyang Liu, Zixiao Gu, Qiang Sun, Guangnan Ye, Yanwei Fu, Yu-Gang Jiang
arXiv AI
Oct 2

UrbanVLA: A Vision-Language-Action Model for Urban Micromobility

UrbanVLA is a Vision‑Language‑Action framework designed to enable delivery robots to navigate large‑scale urban environments using long‑horizon route instructions. The model aligns noisy route waypoints with visual observations and plans trajectories, trained through a two‑stage pipeline of supervised fine‑tuning on simulated data and reinforcement fine‑tuning on mixed simulation and real‑world data. Experiments show UrbanVLA outperforms strong baselines by over 55% on the SocialNav task and demonstrates reliable real‑world navigation in large urban settings.

By Anqi Li, Zhiyong Wang, Jiazhao Zhang, Minghan Li, Yunpeng Qi, Zhibo Chen, Zhizheng Zhang, He Wang
arXiv Computer Vision
5d ago

WildOS: Open-Vocabulary Object Search in the Wild

WildOS is a unified system that enables long‑range, open‑vocabulary object search in unstructured outdoor environments by combining safe geometric exploration with semantic visual reasoning. It constructs a sparse navigation graph for spatial memory and uses the ExploRFM vision module to score frontier nodes, predicting traversability, visual frontiers, and object similarity in real time. A particle‑filter localization method estimates distant goal positions, allowing the robot to plan toward far‑away targets, and field experiments show WildOS outperforms purely geometric or vision‑based baselines in efficiency and autonomy.

By Hardik Shah, Manthan Patel, Erica Tevere, Deegan Atha, Marcel Kaufmann, Shehryar Khattak, Marco Hutter, Jonas Frey, Patrick Spieler
arXiv AI
Sep 24

FLINT: Fast Lightweight Inference for Traversability

FLINT is a lightweight traversability estimator that uses a 21.6‑million‑parameter backbone—38 times smaller than comparable foundation models—to predict traversability from a single RGB camera. It achieves higher accuracy on held‑out terrain probes and runs at 14.7 FPS on CPU, outperforming a deployed foundation‑model system (WildOS) on 23 of 24 field logs. In closed‑loop field trials, FLINT’s best self‑supervised head reached 99% autonomy, surpassing a human‑label‑trained baseline on the same course.

By William Bonilla, Maxime Boisvert, David-Alexandre Poissant, David Meger, Louis Petit