arXiv AI

Observe, Share, or Predict? Disentangling Partner Information in Embodied Multi-Agent Collaboration

arXiv AI
Oct 7

Partially Observable Zero-shot coordination by Predicting Intention of Partner

The paper introduces Predicting Intention of Partner (PIP), a method for zero‑shot coordination in partially observable settings. PIP employs a Joint‑view VAE to create a partner representation from local observations and uses Partner‑State Belief networks to infer hidden partner states from interaction history. Experiments on Burrito‑PO, Overcooked‑PO, and Melting Pot, along with human evaluation, show that PIP outperforms other methods and demonstrates effective coordination with unseen partners under occlusion.

By Jinnyeong Yang, Yuhwan Jeong, Hoyong Kwon, Minseok Kim, Jihun Kim, Kuk-Jin Yoon
arXiv AI
Oct 7

Attacca: Goal-Directed Control under State Continuity for Long-Horizon Embodied Agents

Attacca is a new approach for training visual goal‑conditioned policies that can handle continuous long‑horizon task execution in embodied agents. It decouples goal images from the execution environment by sampling class‑compatible masked goals from other worlds, enabling the policy to ground targets in the current view via a target‑mask prediction head. The method also introduces behavioral‑phase conditioning to distinguish Search, Approach, and Interact stages, and achieves significant performance gains on Minecraft tasks, outperforming baselines by up to 7× on long‑horizon scenarios.

By Gyusik Seo, Jaehong Yoon
arXiv AI
Jun 9

Benchmarking Open-Ended Multi-Agent Coordination in Language Agents

arXiv:2606. 08340v1 Announce Type: new Abstract: As language models are increasingly deployed as autonomous agents, they must coordinate with others over long horizons in open-ended interactive tasks.

By Kale-ab Abebe Tessera, Andras Szecsenyi, Cameron Barker, Alexander Rutherford, Davide Paglieri, Aidan Scannell, Henry Gouk, Elliot J. Crowley, Tim Rockt\"aschel, Amos Storkey
arXiv AI
5d ago

EmbodiedSkills: World Action Model-augmented Cascaded Skills for Vision-Language-Action Agent

EmbodiedSkills is a skill-based agent framework that enhances frozen vision‑language‑action (VLA) policies with world action models for consequence‑aware action selection. It defines reusable skills for observation, context encoding, candidate generation, consequence prediction, outcome evaluation, candidate comparison, and action execution, organized into five stages that support both continuous action chunks and pick‑and‑place primitives. The framework improves success rates on MetaWorld MT50, CLIPort, and CALVIN benchmarks by incorporating outcome predictions and lightweight comparators while keeping the core policy and observation encoders frozen.

By Wei Wang, Wenqiao Zhang, Yutong Lin, Yuqian Yuan, Tianwei Lin, Jinhao Mao, Zhenxuan Fan, Mingjian Gao, Yang Dai, Wentong Li, Zheqi Lv, Zheng Dong, Yingjie Niu, Jiaqi Zhu, Jun Xiao, Chao Li, Yueting Zhuang
arXiv Machine Learning
5d ago

Narrowing the Collaboration Gap, Probably

arXiv:2610.19215v1 Announce Type: new Abstract: Large language models are increasingly deployed as teams of agents that hold different private information about a shared task. How should such agents...

By Mirah Shi, Marcel Hussing, Ira Globus-Harris, Natalie Collina, Aaron Roth, Surbhi Goel