GRDC: A Unified Graph-Driven Framework for Role Discovery and Communication in Multi-Agent Reinforcement Learning
Zihong Gao, Hongjian Liang, Yuanhui Hao, Lei Hao, Liangjun Ke
Abstract
Effective coordination in Multi-Agent Reinforcement Learning (MARL) is particularly challenging under partial observability, where agents must identify and coordinate with task-relevant collaborators based solely on local information. Existing methods can be categorised into communicationbased approaches, which allow message exchange but either rigidly predefine or misidentify collaborators, and rolebased approaches, which promote functional specialization based on observed behavioural similarity. However, both paradigms overlook the dynamic and context-specific cooperative dependencies induced by the task, which determine which agents should collaborate, thereby leading to miscommunication or role misassignment under partial observability. We introduce GRDC (Graph-driven Role Discovery and Communication), a unified framework that approximates these dependencies by dynamically constructing local interaction graphs from trajectory embeddings, then uses these graphs to infer roles via prototype matching and to restrict communication to intra-role agents with attention-based aggregation. In addition to role inference and communication, GRDC promotes a structured and compact role space by maximising role entropy, decorrelating prototypes, and dynamically pruning redundant prototypes. Experimental results on Predator Prey, Cooperative Navigation, and SMACv2 demonstrate that GRDC consistently outperforms state-of-the-art communication-and role-based baselines, improving coordination efficiency and training stability across tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ace602c9-a1a0-45f9-9ff2-6fe3002c7e5fBuilds on14
- Graph Convolutional Reinforcement LearningJiechuan Jiang, Chen Dun, Tiejun Huang, Zongqing LuICLR 2020 · 415 citations
- Multi-Agent Game Abstraction via Graph Attention Neural NetworkYong Liu, Weixun Wang, Yujing Hu, Jianye Hao et al.AAAI 2020 · 316 citations
- ROMA: Multi-Agent Reinforcement Learning with Emergent RolesTonghan Wang, Heng Dong, Victor R. Lesser, Chongjie ZhangICML 2020 · 286 citations
- Balanced Contrastive Learning for Long-Tailed Visual RecognitionJianggang Zhu, Zheng Wang, Jingjing Chen, Yi-Ping Phoebe Chen et al.CVPR 2022 · 194 citations
- Learning Nearly Decomposable Value Functions Via Communication MinimizationTonghan Wang, Jianhao Wang, Chongyi Zheng, Chongjie ZhangICLR 2020 · 170 citations
Related papers
- R3DM: Enabling Role Discovery and Diversity Through Dynamics Models in Multi-agent Reinforcement LearningHarsh Goel, Mohammad Omama, Behdad Chalaki, Vaishnav Tadiparthi et al.ICML 2025
- Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement LearningQian Long, Zihan Zhou, Abhinav Gupta, Fei Fang et al.ICLR 2020
- Coordination Between Individual Agents in Multi-Agent Reinforcement LearningYang Zhang, Qingyu Yang, Dou An, Chengwei ZhangAAAI 2021 · 21 citations
- Enhancing Cooperative Multi-Agent Reinforcement Learning with State Modelling and Adversarial ExplorationAndreas Kontogiannis, Konstantinos Papathanasiou, Yi Shen, Giorgos Stamou et al.ICML 2025
- Bridging Training and Execution via Dynamic Directed Graph-Based Communication in Cooperative Multi-Agent SystemsZhuohui Zhang, Bin He, Bin Cheng, Gang LiAAAI 2025 · 10 citations
