Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2605.13119v2 Announce Type: replace-cross Abstract: Vision-language-action (VLA) models are effective robot action executors, but they remain limited on long-horizon tasks due to the dual burde...
arXiv:2510.26915v2 Announce Type: replace-cross Abstract: While heterogeneous teams have typically been designed for well-specified missions with known semantics, generative intelligence, i.e., large...
arXiv:2503. 22122v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the environment for task decomposition.
SuperNav is a navigation system that leverages a pretrained multimodal large language model (MLLM) without fine‑tuning it for navigation. The system introduces an agent harness that delegates motion execution to navigation tools while the MLLM focuses on interpreting requests, understanding scenes, and making decisions. A visual‑point interface connects the model’s decisions to motion, allowing direct destination specification and feedback‑driven revision, enabling sustained navigation across varied tasks and environments.
arXiv:2609.27816v1 Announce Type: cross Abstract: Safe coordination in heterogeneous machine-to-machine (M2M) robotic systems is challenging when robots differ in sensing capabilities, environmental...
DuoMind is a distributed hierarchical framework that enables multi-robot coordination by combining vision-language-action models for low‑level execution with vision-language models for high‑level reasoning and inter‑robot communication. Each robot’s orchestrator processes task instructions, local observations, and messages from peers to generate precise action commands and semantic messages for other robots. The authors introduce RoboPoly, a benchmark of long‑horizon manipulation tasks, and show through experiments that DuoMind improves multi‑robot task performance, with ablation studies highlighting the roles of hierarchical orchestration and semantic communication.