arXiv AI

Controlling Collectives of AI Agents in Reasoning Space with Spatial Transformers

The paper introduces COMPASS, a decentralized architecture that uses spatial transformers to generate local feedback tokens for large collectives of AI agents in robotics. By aggregating multi‑hop messages, COMPASS enables scalable control of up to 1024 robots, achieving cohesive flocking formations and accurate execution of natural language commands. Experiments show that structured diversity in input commands improves performance and that learned feedback tokens outperform hand‑crafted raw state feedback.

arXiv AI
Sep 23

Heterogeneous Robot Collaboration in Unstructured Environments with Grounded Generative Intelligence

arXiv:2510.26915v2 Announce Type: replace-cross Abstract: While heterogeneous teams have typically been designed for well-specified missions with known semantics, generative intelligence, i.e., large...

By Zachary Ravichandran, Fernando Cladera, Ankit Prabhu, Jason Hughes, Carlos Nieto-Granda, Varun Murali, Camillo Taylor, George J. Pappas, Vijay Kumar
arXiv AI
Sep 7

A Schema Bounded Language Model for Refining Robot Policies Without Destabilizing Local Learning

The paper presents a decentralized navigation framework for composite heterogeneous robots that integrates a large language model (LLM) policy agent, an Upper Confidence Bound (UCB) bandit, and a Double Deep Q-Network (Double DQN) controller. Each robot independently generates and refines policies at the round level using LLM inference, while the Double DQN handles tick-level action selection based on navigation variables and LLM priors. Across 30 rounds, the full configuration achieved all goals with the lowest median completion time (42 ticks) and a 25–39% improvement over other setups.

By Chongwen Dong, Mithun Paul Saint-Germain, Pinjari Asif, Carlo R. daCunha
arXiv AI
Sep 17

AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution

AeroWeaver is a new embodied‑agent harness that integrates large language model (LLM) decision making with the executable skills of individual UAVs, enabling distributed, adaptive swarm execution. It connects semantic mission decisions to governed skills, organizes role‑conditioned local agents for coordination, and refines skill selection online using role‑indexed state‑action‑reward experience. Experiments demonstrate that AeroWeaver maintains valid skill execution without a central joint‑action generator and supports reward‑guided, training‑free adaptive learning from accumulated execution experience.

By Jiabin Lou, Yirong Yang, Haopeng Wang, Xuxin Lv, Xinyu Liu, Diyuan Hou, Xuehong Liu, Rongye Shi, Wenjun Wu
arXiv AI
Jul 14

Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policies

arXiv:2607. 10991v1 Announce Type: cross Abstract: As mobile robots become more integrated into everyday human environments, social robot navigation is becoming essential for ensuring human comfort, safety, and trust.

By Ali Ahmadi, Hamed Rahimi, Adrien Jacquet Cretides, Marie Samson, Mahdi Khoramshahi, Mohamed Chetouani
arXiv AI
Sep 18

Communication and Verification in LLM Agents towards Collaboration under Information Asymmetry

The paper investigates how Large Language Model (LLM) agents can collaborate on a shared task under information asymmetry, using a table‑top version of Einstein Puzzles. It introduces a fine‑tuning‑plus‑verifier framework that equips agents with communication strategies and environmental verification signals. Results show that aligned communication is crucial for rule understanding and human trust, while a verifier improves task comprehension and promotes safer, interpretable collaboration.

By Run Peng, Ziqiao Ma, Amy Pang, Sikai Li, Zhang Xi-Jia, Yingzhuo Yu, Cristian-Paul Bara, Joyce Chai