ReMemNav: Memory-Based Decision Correction and Target Verification for Zero-Shot Object Navigation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Building memory is essential for long-horizon planning in zero-shot embodied navigation. Detector-centric scene graphs often compress observations into sparse nodes, discarding fine-grained visual evidence and accumulating noise, while 3D reconstruction-based methods remain computationally prohibitive.
The paper investigates how an 8‑billion‑parameter vision‑language navigation system should store and organize past observations for zero‑shot navigation. It proposes a structured memory comprising task progress, hierarchically compressed observation history tied to poses, and accumulated geometry, which an observer summarizes and a reasoner uses to select waypoint intents or request new views. Experiments on R2R‑CE and real‑world Unitree Go2 robots show that preserving temporal and spatial memories improves success rates and path efficiency compared to baselines that omit these components.
arXiv:2610.14541v1 Announce Type: cross Abstract: Emerging strong Vision-Language Models (VLMs) have advanced navigation foundation models. However, these models still have unsatisfactory performance...
arXiv:2609.06476v1 Announce Type: cross Abstract: Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires an embodied agent to navigate unseen environments by following natural la...
Goal2Pixel introduces a pixel‑based approach for vision‑language navigation in continuous environments, replacing low‑level action prediction with navigable pixel grounding. The model predicts a visible pixel on the image plane, which is back‑projected into a 3D waypoint for forward motion, while auxiliary regions handle turning and stopping. Coupled with a visibility‑aware keyframe memory (ViKeyMem) and semantic embeddings, Goal2Pixel achieves state‑of‑the‑art performance on R2R‑CE and RxR‑CE with significantly fewer VLM calls.
arXiv:2606. 00095v1 Announce Type: cross Abstract: Vision-Language Navigation (VLN) enables embodied agents to reach target locations in unseen environments by following language instructions.