Communication-efficient Multi-Agent Reinforcement Learning with Spatiotemporal Information Hub
Ling Ding, Tianbai Lyu, Zhiliang Bi, Hao Wang, Shanshan Feng, Wei Yu
摘要
Centralized training with decentralized execution (CTDE) is a framework for MARL with wide applications. In the CTDE paradigm, agents leverage global state information during training to mitigate the non-stationarity of the MARL environment, but must rely solely on partial observations during execution. Recent work has highlighted the growing importance of inter-agent communication for more effective learning and coordination. However, most existing methods overlook the fact that real-world communication channels are often bandwidth-constrained and imperfectly reliable. Toward more communication-efficient and robust MARL, we extend the conventional CTDE framework with an information hub. The hub collects local observations from the agents to restore the global state, which is then delivered to the agents on demand. To this end, technical mechanisms are designed to enable effective global reconstruction with incomplete observations, as well as agent-specific attention to the reconstructed global information. Experiments on multiple cooperative MARL benchmarks demonstrate that our method achieves state-of-the-art performance compared to popular MARL algorithms while substantially reducing communication overhead and exhibiting strong robustness under imperfect communication channels.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- QPLEX: Duplex Dueling Multi-Agent Q-LearningJianhao Wang, Zhizhou Ren, Terry Liu, Yang Yu 等ICLR 2021 · 被引用 595 次
- Graph Convolutional Reinforcement LearningJiechuan Jiang, Chen Dun, Tiejun Huang, Zongqing LuICLR 2020 · 被引用 415 次
- Multi-Agent Game Abstraction via Graph Attention Neural NetworkYong Liu, Weixun Wang, Yujing Hu, Jianye Hao 等AAAI 2020 · 被引用 316 次
- Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution NetworksJianhong Wang, Wangkun Xu, Yunjie Gu, Wenbin Song 等NeurIPS 2021 · 被引用 216 次
- Learning Nearly Decomposable Value Functions Via Communication MinimizationTonghan Wang, Jianhao Wang, Chongyi Zheng, Chongjie ZhangICLR 2020 · 被引用 170 次
相关 Paper
- MA2E: Addressing Partial Observability in Multi-Agent Reinforcement Learning with Masked Auto-EncoderSehyeok Kang, Yongsik Lee, Gahee Kim, Song Chong 等ICLR 2025
- Multi-Agent Guided Policy OptimizationYueheng Li, Guangming Xie, Zongqing LuICLR 2026 · 被引用 4 次
- Complementary Attention for Multi-Agent Reinforcement LearningJianzhun Shao, Hongchang Zhang, Yun Qu, Chang Liu 等ICML 2023 · 被引用 17 次
- GTDE: Grouped Training with Decentralized Execution for Multi-agent Actor-CriticMengxian Li, Qi Wang, Yongjun XuAAAI 2025 · 被引用 5 次
- Self-Organized Group for Cooperative Multi-agent Reinforcement LearningJianzhun Shao, Zhiqiang Lou, Hongchang Zhang, Yuhang Jiang 等NeurIPS 2022 · 被引用 41 次
