arXiv AI
Jul 13

Heterogeneous Information-Bottleneck Coordination Graphs for Multi-Agent Reinforcement Learning

arXiv:2605. 17393v2 Announce Type: replace Abstract: Coordination graphs are a central abstraction in cooperative multi-agent reinforcement learning (MARL), yet existing sparse-graph learners lack a theoretically grounded mechanism to decide which edges should exist and how much information each edge should carry.

By Wei Duan, Junyu Xuan, En Yu, Xiaoyu Yang, Jie Lu
arXiv Machine Learning
Oct 8

Continual Graph Multi-Agent Reinforcement Learning

The paper introduces Continual Graph Multi-Agent Reinforcement Learning (CGMARL), a framework that maps sequences of tasks into attributed graphs to capture task-specific structures such as network topologies or formation arrangements. It presents the Graph-based Formation (GRAFO) benchmark to illustrate forgetting in graph-based CMARL settings and proposes the Frozen Graph Encoder (FROG) to preserve past structural information using a frozen graph backbone. Experiments on GRAFO demonstrate that combining FROG with existing continual learning methods significantly improves performance across multiple CGMARL scenarios.

By Tommaso Marzi, Ahmed Hendawy, Jan Peters, Carlo D'Eramo, Andrea Cini, Cesare Alippi