GRDC: A Unified Graph-Driven Framework for Role Discovery and Communication in Multi-Agent Reinforcement Learning
Zihong Gao, Hongjian Liang, Yuanhui Hao, Lei Hao, Liangjun Ke
摘要
Effective coordination in Multi-Agent Reinforcement Learning (MARL) is particularly challenging under partial observability, where agents must identify and coordinate with task-relevant collaborators based solely on local information. Existing methods can be categorised into communicationbased approaches, which allow message exchange but either rigidly predefine or misidentify collaborators, and rolebased approaches, which promote functional specialization based on observed behavioural similarity. However, both paradigms overlook the dynamic and context-specific cooperative dependencies induced by the task, which determine which agents should collaborate, thereby leading to miscommunication or role misassignment under partial observability. We introduce GRDC (Graph-driven Role Discovery and Communication), a unified framework that approximates these dependencies by dynamically constructing local interaction graphs from trajectory embeddings, then uses these graphs to infer roles via prototype matching and to restrict communication to intra-role agents with attention-based aggregation. In addition to role inference and communication, GRDC promotes a structured and compact role space by maximising role entropy, decorrelating prototypes, and dynamically pruning redundant prototypes. Experimental results on Predator Prey, Cooperative Navigation, and SMACv2 demonstrate that GRDC consistently outperforms state-of-the-art communication-and role-based baselines, improving coordination efficiency and training stability across tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Graph Convolutional Reinforcement LearningJiechuan Jiang, Chen Dun, Tiejun Huang, Zongqing LuICLR 2020 · 被引用 415 次
- Multi-Agent Game Abstraction via Graph Attention Neural NetworkYong Liu, Weixun Wang, Yujing Hu, Jianye Hao 等AAAI 2020 · 被引用 316 次
- ROMA: Multi-Agent Reinforcement Learning with Emergent RolesTonghan Wang, Heng Dong, Victor R. Lesser, Chongjie ZhangICML 2020 · 被引用 286 次
- Balanced Contrastive Learning for Long-Tailed Visual RecognitionJianggang Zhu, Zheng Wang, Jingjing Chen, Yi-Ping Phoebe Chen 等CVPR 2022 · 被引用 194 次
- Learning Nearly Decomposable Value Functions Via Communication MinimizationTonghan Wang, Jianhao Wang, Chongyi Zheng, Chongjie ZhangICLR 2020 · 被引用 170 次
相关 Paper
- R3DM: Enabling Role Discovery and Diversity Through Dynamics Models in Multi-agent Reinforcement LearningHarsh Goel, Mohammad Omama, Behdad Chalaki, Vaishnav Tadiparthi 等ICML 2025
- Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement LearningQian Long, Zihan Zhou, Abhinav Gupta, Fei Fang 等ICLR 2020
- Coordination Between Individual Agents in Multi-Agent Reinforcement LearningYang Zhang, Qingyu Yang, Dou An, Chengwei ZhangAAAI 2021 · 被引用 21 次
- Enhancing Cooperative Multi-Agent Reinforcement Learning with State Modelling and Adversarial ExplorationAndreas Kontogiannis, Konstantinos Papathanasiou, Yi Shen, Giorgos Stamou 等ICML 2025
- Bridging Training and Execution via Dynamic Directed Graph-Based Communication in Cooperative Multi-Agent SystemsZhuohui Zhang, Bin He, Bin Cheng, Gang LiAAAI 2025 · 被引用 10 次
