arXiv AI

Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination

The paper introduces Embodied Semantic Communication (ESC), a new paradigm that redefines information transmission for autonomous agents by embedding multimodal perceptual states, hardware capabilities, and collaborative intents into unified, action‑oriented semantic representations. ESC enables heterogeneous agents to parse, align, and ground shared information directly into local motor control, addressing the limitations of traditional communication approaches that focus solely on bit delivery or single‑task optimization. The tutorial outlines ESC’s conceptual boundaries, system characteristics, and technical pathways, mapping relevant mathematical tools such as semantic information theory, world models, and multi‑agent decision theory, and concludes with a roadmap of open challenges like semantic reliability, dynamic interaction, and bandwidth‑adaptive transmission.

arXiv AI
Jul 7

Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systems

arXiv:2607. 03283v1 Announce Type: new Abstract: Embodied intelligence systems require not only end-to-end policy models, but also reusable functional modules that transform multimodal observations, robot states, human demonstrations, and task contexts into structured representations, decisions, trajectories, control references, and system services.

By Junwu Xiong, Jiaxuan Gao, Wei Chai, Renxing Chen, Yuzhen Li, Yu Guo, Yucheng Guo, Mingxi Luo, Wenyang Ma, Yiyun Mou, Yifei Zhang, Chen Zhou, Yongjian Guo
arXiv AI
Oct 2

Token Communication-Assisted Collaborative Embodied Artificial Intelligence: Concepts, Framework, and Opportunities

The paper introduces Token Communication (TokCom) as a native interface for Collaborative Embodied Artificial Intelligence (CEAI), where tokens act as compact semantic carriers and inference units for generative foundation models. It outlines a TokCom-assisted CEAI framework featuring a task‑adaptive communication protocol that includes a compact codebook, syntax rules, and contextual examples to guide token distillation and reconstruction over wireless channels. A case study on collaborative object transport shows that TokCom significantly reduces source payload bit consumption while maintaining task efficiency and robustness to noisy channels.

By Peng Yi, Ying-Chang Liang
Hugging Face Trending Papers
Jul 13

From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence

Artificial general intelligence ultimately requires agents that can reason and act in the physical world. Action models, vision-language-action policies, and world models have advanced this goal, while World Action Models (WAMs) are particularly promising because they connect candidate interventions with predicted consequences.

arXiv AI
Jun 26

Advancing Omnimodal Embodied Agents from Isolated Skills to Everyday Physical Autonomy

arXiv:2606. 27251v1 Announce Type: cross Abstract: Building persistent embodied agents in unstructured environments demands unified orchestration of heterogeneous tools spanning both cyber (APIs, IoT) and physical (manipulation, navigation) domains, coupled with autonomous recovery from physical failures that inevitably arise over extended operation.

By Junhao Shi, Zezheng Huai, Siyin Wang, Jia Chen, Yubang Wang, Zhaoye Fei, Hechang Chen, Jingjing Gong, Xipeng Qiu, Yu-Gang Jiang
Hugging Face Trending Papers
Jun 25

Advancing Omnimodal Embodied Agents from Isolated Skills to Everyday Physical Autonomy

Building persistent embodied agents in unstructured environments demands unified orchestration of heterogeneous tools spanning both cyber (APIs, IoT) and physical (manipulation, navigation) domains, coupled with autonomous recovery from physical failures that inevitably arise over extended operation. Existing systems treat these as separate problems: VLM-based planners lack a unified cyber-physical action space, agent frameworks accumulate unbounded context that degrades temporal coherence, and VLA policies execute open-loop without detecting their own failures.

arXiv AI
Aug 21

Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents

arXiv:2608. 19794v1 Announce Type: new Abstract: The convergence of large language models (LLMs), structured knowledge bases (KBs), and reasoning ability (RA) presents a promising trajectory toward general embodied intelligence (GEI).

By Fujiang Yuan, Xia Huang, Lusheng Wang, Jun Ding, Zhen Tian, Yuxin Wang, Shaojie Gu, Yuki Funabora, Yanhong Peng, Zebing Mao
arXiv Computer Vision
Oct 22

Multimodal Embodied Agents: A Unified Capability-centric Perspective from Computer-Use to Robot-Use

The paper introduces Multimodal Embodied Agents (MMEAs), goal‑directed systems that combine multimodal task reasoning with physical action and adapt decisions based on feedback. It proposes the PAPAV framework, which defines five core capabilities—Perceive, Anticipate, Plan, Act, Verify—common to computer‑use agents, robotic systems, and MMEAs. The authors analyze 64 benchmarks, noting that most evaluations focus on Act while Anticipate and Verify are rarely assessed, highlighting gaps and open challenges in designing reliable physical agents.

By Yanzhe Chen, Ziyi Yang, Jifeng Zhu, Qiming Huang, Ruihe An, Peiyao Xu, Hesen Yang, Runda Liu, Chang Gong, Zhijun Cao, Zechen Bai, Wenzheng Zeng, Yiqi Lin, Guoqiang Liang, Kevin Yuchen Ma, Kevin Qinghong Lin, Mike Zheng Shou
arXiv Computer Vision
Sep 22

General Collaborative Intelligence: Architecting Cognition for Resilient Multi-Agent Ecosystems

The paper reviews the evolution of multi‑agent unmanned systems from isolated sensing to collaborative intelligence, where agents share compact features to overcome local observation limits such as occlusions and sensor range. It introduces a five‑dimensional taxonomy (collaboration stage, communication paradigm, fusion architecture, learning strategy, application domain) and three cognitive synergy conditions (Semantic Disambiguation, Pragmatic Information Exchange, Proactive Informational Foraging) to unify existing research. The authors survey architectures, neural‑communication co‑design, embodied action‑perception loops, and resilience mechanisms, map advances onto operational domains (V2X, UAV, logistics, smart cities), and propose the GCI‑Bench scoring protocol to standardize evaluation across studies.

By Lei Zhang, Chun Ye, Le Yang, Zhaozhong Wang, Deng-Ping Fan, Hang Dai, Binglu Wang