Emergent Communication under Varying Sizes and Connectivities
Jooyeon Kim, Alice Oh
Abstract
Recent advances in deep neural networks allowed artificial agents to derive their own emergent languages that promote interaction, coordination, and collaboration within a group. Just as we humans have succeeded in creating a shared language that allows us to interact within a large group, can the emergent communication within an artificial group converge to a shared, agreed language? This research provides an analytical study of the shared emergent language within the group communication settings of different sizes and connectivities. As the group size increases up to hundreds, agents start to speak dissimilar languages, but the rate at which they successfully communicate is maintained. Remarkably, we also show an evidence of the shared language becoming more generalizable at describing new referents with increased group size. We observe the emergence of different dialects when we restrict the group communication to have local connectivities only. Finally, we provide an optimization result of group communication graphs when the number of agents one can communicate with is restricted.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 17f2e47b-165b-4a40-adcb-e2898500209bCited by top-tier papers4
- Emergent Communication: Generalization and Overfitting in Lewis GamesMathieu Rita, Corentin Tallec, Paul Michel, Jean-Bastien Grill et al.NeurIPS 2022 · 41 citations
- Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional CommunicationLukasz Kucinski, Tomasz Korbak, Pawel Kolodziej, Piotr MilosNeurIPS 2021 · 25 citations
- One-to-Many Communication and Compositionality in Emergent CommunicationHeeyoung LeeEMNLP 2024 · 3 citations
- Emergent Communication Under MisinformationHeeyoung Lee, Kyungwoo SongICML 2026
Builds on4
- Environmental drivers of systematicity and generalization in a situated agentFelix Hill, Andrew K. Lampinen, Rosalia Schneider, Stephen Clark et al.ICLR 2020 · 109 citations
- Simplified Action Decoder for Deep Multi-Agent Reinforcement LearningHengyuan Hu, Jakob N. FoersterICLR 2020 · 88 citations
- On the interaction between supervision and self-play in emergent communicationRyan Lowe, Abhinav Gupta, Jakob N. Foerster, Douwe Kiela et al.ICLR 2020 · 30 citations
- Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language LearningAngeliki Lazaridou, Anna Potapenko, Olivier TielemanACL 2020 · 11 citations
Related papers
- Compositionality and Generalization In Emergent LanguagesRahma Chaabouni, Eugene Kharitonov, Diane Bouchacourt, Emmanuel Dupoux et al.ACL 2020 · 40 citations
- Expressivity of Emergent Languages is a Trade-off between Contextual Complexity and UnpredictabilityShangmin Guo, Yi Ren, Kory Wallace Mathewson, Simon Kirby et al.ICLR 2022 · 13 citations
- Interpretable agent communication from scratch (with a generic visual processor emerging on the side)Roberto Dessì, Eugene Kharitonov, Marco BaroniNeurIPS 2021 · 33 citations
- On the role of population heterogeneity in emergent communicationMathieu Rita, Florian Strub, Jean-Bastien Grill, Olivier Pietquin et al.ICLR 2022 · 30 citations
- Emergent Communication at ScaleRahma Chaabouni, Florian Strub, Florent Altché, Eugene Tarassov et al.ICLR 2022 · 65 citations
