Role-Level Inductive Bias for Cross-Task Generalization in Multi-Agent Reinforcement Learning
Chang Yao, Youfang Lin, Shoucheng Song, Hao Wu, Shengkun Yang, Yuqing Ma, Kai Lv
摘要
Achieving cross-task generalization remains a critical challenge in Multi-Agent Reinforcement Learning (MARL), fundamentally relying on effective inductive biases. However, existing entity-level biases often overlook collaborative patterns, whereas task-level biases lack sufficient coverage for novel scenarios. To address this, we introduce a role-level inductive bias as an intermediate abstraction that integrates entity-level flexibility with task-level inter-agent collaboration. To instantiate this, we propose Gaussian-mixture-model-based Transferable Role discovery (GTR). Specifically, GTR constructs a structured role space to ensure diverse role assignment, further achieves role decoupling via regularization, and ultimately utilizes these roles for efficient generalization. Empirical results demonstrate that GTR achieves superior zero-shot and few-shot transfer performance on unseen tasks compared to state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- ROMA: Multi-Agent Reinforcement Learning with Emergent RolesTonghan Wang, Heng Dong, Victor R. Lesser, Chongjie ZhangICML 2020 · 被引用 286 次
- RODE: Learning Roles to Decompose Multi-Agent TasksTonghan Wang, Tarun Gupta, Anuj Mahajan, Bei Peng 等ICLR 2021 · 被引用 60 次
- Effective and Stable Role-Based Multi-Agent Collaboration by Structural Information PrinciplesXianghua Zeng, Hao Peng, Angsheng LiAAAI 2023 · 被引用 58 次
- Attention-Guided Contrastive Role Representations for Multi-agent Reinforcement LearningZican Hu, Zongzhang Zhang, Huaxiong Li, Chunlin Chen 等ICLR 2024 · 被引用 27 次
- Decompose a Task into Generalizable Subtasks in Multi-Agent Reinforcement LearningZikang Tian, Ruizhi Chen, Xing Hu, Ling Li 等NeurIPS 2023 · 被引用 23 次
相关 Paper
- Decentralized and Disentangled Task–Role Representation Learning for Generalizable Offline Multi-Agent Meta Reinforcement Learninglei yuan, Ruiqi Xue, Yang YuICML 2026
- Structured Expert Routing with Multi-View Task Priors for Offline Meta-Reinforcement LearningYisen Zhao, Peixi Peng, Xinyu Hu, Cong Li 等ICML 2026
- ADAPT: Adaptive Decentralized Architecture with Perception-Aligned Training for Structural Generalization in Multi-Agent RLZhixiang Zhang, Shuo Chen, Yexin Li, Feng WangAAAI 2026 · 被引用 1 次
- GRDC: A Unified Graph-Driven Framework for Role Discovery and Communication in Multi-Agent Reinforcement LearningZihong Gao, Hongjian Liang, Yuanhui Hao, Lei Hao 等AAAI 2026
- Meta-DT: Offline Meta-RL as Conditional Sequence Modeling with World Model DisentanglementZhi Wang, Li Zhang, Wenhao Wu, Yuanheng Zhu 等NeurIPS 2024 · 被引用 31 次
