← Back to all news
arXiv Computer Vision By Hardik Shah, Manthan Patel, Erica Tevere, Deegan Atha, Marcel Kaufmann, Shehryar Khattak, Marco Hutter, Jonas Frey, Patrick Spieler

WildOS: Open-Vocabulary Object Search in the Wild

Read the original on arXiv Computer Vision →

WildOS is a unified system that enables long‑range, open‑vocabulary object search in unstructured outdoor environments by combining safe geometric exploration with semantic visual reasoning. It constructs a sparse navigation graph for spatial memory and uses the ExploRFM vision module to score frontier nodes, predicting traversability, visual frontiers, and object similarity in real time. A particle‑filter localization method estimates distant goal positions, allowing the robot to plan toward far‑away targets, and field experiments show WildOS outperforms purely geometric or vision‑based baselines in efficiency and autonomy.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Oct 16

RoboAtlas: Contextual Active SLAM

RoboAtlas is a contextual Active SLAM framework that balances geometric exploration with semantic reasoning through a scalable 3D semantic mapping system called OpenRoboVox. It uses frontier exploration, global semantic‑map reasoning, and egocentric VLM‑based reasoning guided by a contextual multi‑armed bandit to shift from exploration to semantically guided navigation as scene understanding improves. In simulation and on a Unitree Go2 robot, RoboAtlas achieved a 100% task success rate in environments over 1800 m² with ~30k semantic instances, and outperformed prior baselines on the GOAT‑Bench "Val Unseen" benchmark, reaching 90.6% SR with GPT‑4o and 88.8% SR with Qwen2.5‑VL‑7B.

By Alexander Schperberg, Shivam K. Panda, Abraham P. Vinod, Bhagawan Rokaha, M. K. Jawed, Stefano Di Cairano
llmsreinforcement-learningroboticsmultimodalbenchmarks
More like this →
arXiv AI
Sep 17

Visual Cue Guided Video Planning for Generalizable Robot Navigation

CueNav is a video model-based navigation framework that uses visual cues—a Bird's-Eye View map for global task context and a body-aware egocentric view for embodiment context—to guide a video planner. The framework couples this planner with an embodiment-specific Inverse-Dynamics Model that translates dense flow fields from the video plan into robot actions. Experiments show that CueNav nearly doubles maze navigation success compared to cue-less planning and achieves 70% success in narrow passages, while also supporting zero-shot semantic-conditioned navigation across different robot platforms.

By Hojin Lee, Sizhe Lester Li, Maximilian Hilger, Susie Lu, Achim J. Lilienthal, Vincent Sitzmann, Daniel A. Duecker
robotics
More like this →