Learning to Ground Multi-Agent Communication with Autoencoders
Toru Lin, Jacob Huh, Christopher Stauffer, Ser-Nam Lim, Phillip Isola
Abstract
Communication requires having a common language, a lingua franca, between agents. This language could emerge via a consensus process, but it may require many generations of trial and error. Alternatively, the lingua franca can be given by the environment, where agents ground their language in representations of the observed world. We demonstrate a simple way to ground language in learned representations, which facilitates decentralized multi-agent communication and coordination. We find that a standard representation learning algorithm -- autoencoding -- is sufficient for arriving at a grounded common language. When agents broadcast these representations, they learn to understand and respond to each other's utterances and achieve surprisingly strong task performance across a variety of multi-agent communication environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8b1489a6-e393-49e7-814f-f5a62b934ce7Cited by top-tier papers10
- FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision MakingYangyang Yu, Zhiyuan Yao, Haohang Li, Zhiyang Deng et al.NeurIPS 2024 · 197 citations
- Efficient Multi-agent Communication via Self-supervised Information AggregationCong Guan, Feng Chen, Lei Yuan, Chenghe Wang et al.NeurIPS 2022 · 65 citations
- Trading off Utility, Informativeness, and Complexity in Emergent CommunicationMycal Tucker, Roger Levy, Julie A. Shah, Noga ZaslavskyNeurIPS 2022 · 34 citations
- Language Grounded Multi-agent Reinforcement Learning with Human-interpretable CommunicationHuao Li, Hossein Nourkhiz Mahjoub, Behdad Chalaki, Vaishnav Tadiparthi et al.NeurIPS 2024 · 31 citations
- Learning Multi-Agent Communication with Contrastive LearningYat Long Lo, Biswa Sengupta, Jakob Nicolaus Foerster, Michael NoukhovitchICLR 2024 · 11 citations
Related papers
- Bridging the Gap: Using Deep Acoustic Representations to Learn Grounded Language from Percepts and Raw SpeechGaoussou Youssouf Kebe, Luke E. Richards, Edward Raff, Francis Ferraro et al.AAAI 2022 · 5 citations
- Consensus Learning for Cooperative Multi-Agent Reinforcement LearningZhiwei Xu, Bin Zhang, Dapeng Li, Zeren Zhang et al.AAAI 2023 · 27 citations
- Few-shot Language Coordination by Modeling Theory of MindHao Zhu, Graham Neubig, Yonatan BiskICML 2021 · 43 citations
- Emergent Communication of GeneralizationsJesse Mu, Noah D. GoodmanNeurIPS 2021 · 60 citations
- Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied AgentsShivansh Patel, Saim Wani, Unnat Jain, Alexander G. Schwing et al.ICCV 2021 · 30 citations
