arXiv AI

Heterogeneous Robot Collaboration in Unstructured Environments with Grounded Generative Intelligence

arXiv AI
Sep 17

AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution

AeroWeaver is a new embodied‑agent harness that integrates large language model (LLM) decision making with the executable skills of individual UAVs, enabling distributed, adaptive swarm execution. It connects semantic mission decisions to governed skills, organizes role‑conditioned local agents for coordination, and refines skill selection online using role‑indexed state‑action‑reward experience. Experiments demonstrate that AeroWeaver maintains valid skill execution without a central joint‑action generator and supports reward‑guided, training‑free adaptive learning from accumulated execution experience.

By Jiabin Lou, Yirong Yang, Haopeng Wang, Xuxin Lv, Xinyu Liu, Diyuan Hou, Xuehong Liu, Rongye Shi, Wenjun Wu
arXiv AI
Aug 25

Physical Agentic AI: An Architecture for Orchestrating a Robot Crew with LLMs

Physical Agentic AI proposes an architecture that links semantic planning with physical execution for robot crews. Each robot exposes a typed skill library, while a foundation model planner decomposes tasks into phases and assigns robot‑skill pairs. A Robot Orchestrator validates and authorizes one skill at a time, ensuring actions are grounded in robot capabilities, system state, and workflow constraints before actuation.

By Xinyuan Liu, Eren Sadikoglu, Riana Chatterjee, Ransalu Senanayake
arXiv AI
Oct 12

MAGMA-Bench: Evaluating Long-Horizon Embodied Agents under Dynamic Tasks and Execution Failures

MAGMA-Bench is an architecture‑agnostic benchmark designed to evaluate long‑horizon embodied agents in dynamic multi‑robot environments. It tests agents across increasing task horizons and introduces controlled online perturbations such as execution failures, task interruptions, and mission updates, while requiring coordination among robots with heterogeneous capabilities. The benchmark separates task‑level reasoning from perception and low‑level control through a structured skill‑level interface and provides 261,646 task‑level training examples along with an expert‑trace generation pipeline.

By Loan Bernat (LAAS-GEPETTO), Matthieu Grard (LAAS-RAP), Ariane Herbulot (LAAS-RAP), Florent Lamiraux (LAAS-GEPETTO)
arXiv AI
Sep 28

Actively Resolving Contextual Uncertainty for Underspecified Tasks in Natural Language

The paper introduces CLUE, a framework that lets robots actively resolve contextual uncertainty for underspecified natural language tasks. CLUE employs an LLM-derived policy to generate task-relevant hypotheses and plans, then uses an online language-embedded map to ground these into actions, refining its plan through closed-loop interaction. Experiments on a Boston Dynamics Spot across diverse indoor and outdoor settings show CLUE achieving near-oracle performance and outperforming LLM planners without closed-loop feedback by a significant margin.

By Zachary Ravichandran, Jonathan Diller, Fernando Cladera, Varun Murali, George J. Pappas, Vijay Kumar
arXiv AI
Oct 2

DuoMind: Enabling Distributed Multi-Robot Coordination with Semantic Communication

DuoMind is a distributed hierarchical framework that enables multi-robot coordination by combining vision-language-action models for low‑level execution with vision-language models for high‑level reasoning and inter‑robot communication. Each robot’s orchestrator processes task instructions, local observations, and messages from peers to generate precise action commands and semantic messages for other robots. The authors introduce RoboPoly, a benchmark of long‑horizon manipulation tasks, and show through experiments that DuoMind improves multi‑robot task performance, with ablation studies highlighting the roles of hierarchical orchestration and semantic communication.

By Hanchu Zhou, Dechen Gao, Hang Wang, Brendan Lynch, Boqi Zhao, Qiyao Ma, Raman Goyal, Junshan Zhang
arXiv AI
Aug 13

G0.5: One Autoregressive Stream for Robot Reasoning and Action

arXiv:2608. 11739v1 Announce Type: cross Abstract: The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert.

By Yicheng Liu, Zibin Dong, Baijun Ye, Tianyuan Yuan, Tao Jiang, Anqi Yang, Shicheng Cao, Haonan Liu, Yue Sun, Zihan Guo, Xiao Liu, Dong Ke, Changxun Pan, Chenru Wu, Tailai Cheng, Xiaoshu Ren, Xinlei Zhang, Jianning Cui, Zijie Zhao, Haoyu Zhang, Kaiming Xu, Haodong Yang, Bowen Zhang, Jiahui Niu, Shaoting Zhu, Shiduo Zhang, Hang Zhao