Beyond Trial-and-Error: A Geospatial-Guided Active Reasoning Framework for Robust Aerial Vision-and-Language Navigation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2609.08442v1 Announce Type: cross Abstract: Aerial Vision-and-Language Navigation requires drones to follow natural-language instructions and navigate through complex urban environments. Accura...
The paper introduces AeroBelief, a dual‑layer semantic‑spatial belief mapping framework for aerial object goal navigation. It separates broad contextual plausibility (intuition layer) from target‑specific evidence (evidence layer) and fuses them into persistent spatial belief hotspots. The method also employs object‑conditioned visual reasoning and egocentric regional guidance, achieving state‑of‑the‑art success rates on the UAV‑ON benchmark.
arXiv:2606. 28397v1 Announce Type: cross Abstract: Vision-language navigation (VLN) has recently advanced with large language and multimodal models, enabling agents to follow natural-language instructions in unseen environments without training a task-specific navigation policy.
The paper introduces AeroBelief, a dual‑layer semantic‑spatial belief mapping framework for aerial object goal navigation. It separates broad contextual plausibility (intuition layer) from target‑specific evidence (evidence layer) and fuses them into persistent spatial belief hotspots, while also employing object‑conditioned visual reasoning and temporally stable regional guidance. Experiments on the UAV‑ON benchmark show AeroBelief outperforms prior methods in success rate, object success rate, and SPL.
In this paper, we tackle the Aerial Vision-and-Dialog Navigation (AVDN) task in the training-free setting for resource-efficient high-altitude UAV navigation. Naively applying MLLMs leads to unreliable navigation due to weak directional grounding and the lack of explicit spatial memory.
GrabVG is a visual grounding framework for UAV imagery that tackles the challenges of small, densely packed, and visually similar objects by separating the task into preattentive hypothesis search and graph-attentive feature binding. It first generates a compact set of reliable object hypotheses using distillation-guided proposal induction and text-aware filtering, then constructs a sparse graph where language-guided visual cues and inter-instance topological relationships are jointly bound and propagated via graph attention. Experiments on AerialVG and AerialSense demonstrate that GrabVG achieves a strong accuracy–speed trade‑off, reaching 67.31% and 80.34% Acc@0.5 and outperforming baselines by 10.55 and 8.76 percentage points.