arXiv Computer Vision

WildOS: Open-Vocabulary Object Search in the Wild

WildOS is a unified system that enables long‑range, open‑vocabulary object search in unstructured outdoor environments by combining safe geometric exploration with semantic visual reasoning. It constructs a sparse navigation graph for spatial memory and uses the ExploRFM vision module to score frontier nodes, predicting traversability, visual frontiers, and object similarity in real time. A particle‑filter localization method estimates distant goal positions, allowing the robot to plan toward far‑away targets, and field experiments show WildOS outperforms purely geometric or vision‑based baselines in efficiency and autonomy.

arXiv Computer Vision
Oct 16

RoboAtlas: Contextual Active SLAM

RoboAtlas is a contextual Active SLAM framework that balances geometric exploration with semantic reasoning through a scalable 3D semantic mapping system called OpenRoboVox. It uses frontier exploration, global semantic‑map reasoning, and egocentric VLM‑based reasoning guided by a contextual multi‑armed bandit to shift from exploration to semantically guided navigation as scene understanding improves. In simulation and on a Unitree Go2 robot, RoboAtlas achieved a 100% task success rate in environments over 1800 m² with ~30k semantic instances, and outperformed prior baselines on the GOAT‑Bench "Val Unseen" benchmark, reaching 90.6% SR with GPT‑4o and 88.8% SR with Qwen2.5‑VL‑7B.

By Alexander Schperberg, Shivam K. Panda, Abraham P. Vinod, Bhagawan Rokaha, M. K. Jawed, Stefano Di Cairano
arXiv AI
Sep 17

Visual Cue Guided Video Planning for Generalizable Robot Navigation

CueNav is a video model-based navigation framework that uses visual cues—a Bird's-Eye View map for global task context and a body-aware egocentric view for embodiment context—to guide a video planner. The framework couples this planner with an embodiment-specific Inverse-Dynamics Model that translates dense flow fields from the video plan into robot actions. Experiments show that CueNav nearly doubles maze navigation success compared to cue-less planning and achieves 70% success in narrow passages, while also supporting zero-shot semantic-conditioned navigation across different robot platforms.

By Hojin Lee, Sizhe Lester Li, Maximilian Hilger, Susie Lu, Achim J. Lilienthal, Vincent Sitzmann, Daniel A. Duecker
arXiv Computer Vision
Oct 22

AOV-GS: Active Open-Vocabulary Semantic Mapping with 3D Gaussian Splatting

AOV-GS is an active 3D Gaussian mapping system that uses frozen foundation models (SAM and CLIP) to guide exploration toward semantically informative regions. During coarse exploration, it re‑ranks geometrically promising views based on CLIP mask‑embedding novelty from SAM instance segmentation, biasing the robot’s trajectory. The system fits a lightweight scene‑specific language field offline to the collected CLIP embeddings, enabling open‑vocabulary text‑query segmentation on novel views and improving language‑field mIoU by 1.3–1.8 percentage points over geometry‑only planning on Replica and Matterport3D.

By Rodion Shkokov, Tatiana Zemskova, Dmitry Yudin
arXiv AI
Oct 2

UrbanVLA: A Vision-Language-Action Model for Urban Micromobility

UrbanVLA is a Vision‑Language‑Action framework designed to enable delivery robots to navigate large‑scale urban environments using long‑horizon route instructions. The model aligns noisy route waypoints with visual observations and plans trajectories, trained through a two‑stage pipeline of supervised fine‑tuning on simulated data and reinforcement fine‑tuning on mixed simulation and real‑world data. Experiments show UrbanVLA outperforms strong baselines by over 55% on the SocialNav task and demonstrates reliable real‑world navigation in large urban settings.

By Anqi Li, Zhiyong Wang, Jiazhao Zhang, Minghan Li, Yunpeng Qi, Zhibo Chen, Zhizheng Zhang, He Wang