arXiv AI
One MLLM, One Call: Efficient Zero-Shot Vision-and-Language Navigation via Spatial-Aware Waypoints
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jul 1
ViTL: Temporal Logic-Guided Zero-Shot Natural Language Navigation via Vision-Language Models
arXiv:2606. 30696v1 Announce Type: cross Abstract: Enabling robots to follow natural language commands to complete zero-shot long-horizon tasks remains challenging.
arXiv Computer Vision
5d ago
Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation
Goal2Pixel introduces a pixel‑based approach for vision‑language navigation in continuous environments, replacing low‑level action prediction with navigable pixel grounding. The model predicts a visible pixel on the image plane, which is back‑projected into a 3D waypoint for forward motion, while auxiliary regions handle turning and stopping. Coupled with a visibility‑aware keyframe memory (ViKeyMem) and semantic embeddings, Goal2Pixel achieves state‑of‑the‑art performance on R2R‑CE and RxR‑CE with significantly fewer VLM calls.
arXiv Computer Vision
Sep 15
ReMemNav: Memory-Based Decision Correction and Target Verification for Zero-Shot Object Navigation
arXiv:2603.26788v3 Announce Type: replace-cross Abstract: Zero-shot object navigation requires agents to locate unseen targets in unfamiliar environments without prior maps or task-specific training....
arXiv AI
Jul 22
Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigation
arXiv:2602. 15875v2 Announce Type: replace-cross Abstract: Current Visual-Language Navigation (VLN) methodologies face a trade-off between semantic understanding and control precision.
arXiv AI
Jun 2
Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
arXiv:2606. 00095v1 Announce Type: cross Abstract: Vision-Language Navigation (VLN) enables embodied agents to reach target locations in unseen environments by following language instructions.
arXiv Computer Vision
Sep 14
AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation
AnchorVLN is an open‑vocabulary vision‑language navigation system that separates semantic proposals from geometric metrics. It uses a VLM to generate semantics while a geometry module supplies reliable metric quantities such as range and bearing, all within a Model Context Protocol server. The system achieves 64.4% on instruction following and improves object‑reference accuracy, reducing median center error from 3.37 m to 2.48 m.