Role-Level Inductive Bias for Cross-Task Generalization in Multi-Agent Reinforcement Learning
Chang Yao, Youfang Lin, Shoucheng Song, Hao Wu, Shengkun Yang, Yuqing Ma, Kai Lv
Abstract
Achieving cross-task generalization remains a critical challenge in Multi-Agent Reinforcement Learning (MARL), fundamentally relying on effective inductive biases. However, existing entity-level biases often overlook collaborative patterns, whereas task-level biases lack sufficient coverage for novel scenarios. To address this, we introduce a role-level inductive bias as an intermediate abstraction that integrates entity-level flexibility with task-level inter-agent collaboration. To instantiate this, we propose Gaussian-mixture-model-based Transferable Role discovery (GTR). Specifically, GTR constructs a structured role space to ensure diverse role assignment, further achieves role decoupling via regularization, and ultimately utilizes these roles for efficient generalization. Empirical results demonstrate that GTR achieves superior zero-shot and few-shot transfer performance on unseen tasks compared to state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on14
- ROMA: Multi-Agent Reinforcement Learning with Emergent RolesTonghan Wang, Heng Dong, Victor R. Lesser, Chongjie ZhangICML 2020 · 286 citations
- RODE: Learning Roles to Decompose Multi-Agent TasksTonghan Wang, Tarun Gupta, Anuj Mahajan, Bei Peng et al.ICLR 2021 · 60 citations
- Effective and Stable Role-Based Multi-Agent Collaboration by Structural Information PrinciplesXianghua Zeng, Hao Peng, Angsheng LiAAAI 2023 · 58 citations
- Attention-Guided Contrastive Role Representations for Multi-agent Reinforcement LearningZican Hu, Zongzhang Zhang, Huaxiong Li, Chunlin Chen et al.ICLR 2024 · 27 citations
- Decompose a Task into Generalizable Subtasks in Multi-Agent Reinforcement LearningZikang Tian, Ruizhi Chen, Xing Hu, Ling Li et al.NeurIPS 2023 · 23 citations
Related papers
- Decentralized and Disentangled Task–Role Representation Learning for Generalizable Offline Multi-Agent Meta Reinforcement Learninglei yuan, Ruiqi Xue, Yang YuICML 2026
- Structured Expert Routing with Multi-View Task Priors for Offline Meta-Reinforcement LearningYisen Zhao, Peixi Peng, Xinyu Hu, Cong Li et al.ICML 2026
- ADAPT: Adaptive Decentralized Architecture with Perception-Aligned Training for Structural Generalization in Multi-Agent RLZhixiang Zhang, Shuo Chen, Yexin Li, Feng WangAAAI 2026 · 1 citation
- GRDC: A Unified Graph-Driven Framework for Role Discovery and Communication in Multi-Agent Reinforcement LearningZihong Gao, Hongjian Liang, Yuanhui Hao, Lei Hao et al.AAAI 2026
- Meta-DT: Offline Meta-RL as Conditional Sequence Modeling with World Model DisentanglementZhi Wang, Li Zhang, Wenhao Wu, Yuanheng Zhu et al.NeurIPS 2024 · 31 citations
