Incorporating Pragmatic Reasoning Communication into Emergent Language
Yipeng Kang, Tonghan Wang, Gerard de Melo
Abstract
Emergentism and pragmatics are two research fields that study the dynamics of linguistic communication along substantially different timescales and intelligence levels. From the perspective of multi-agent reinforcement learning, they correspond to stochastic games with reinforcement training and stage games with opponent awareness. Given that their combination has been explored in linguistics, we propose computational models that combine short-term mutual reasoning-based pragmatics with long-term language emergentism. We explore this for agent communication referential games as well as in Starcraft II, assessing the relative merits of different kinds of mutual reasoning pragmatics models both empirically and theoretically. Our results shed light on their importance for making inroads towards getting more natural, accurate, robust, fine-grained, and succinct utterances.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cfa0d56d-62d9-4b9f-8fcc-c4d337c4524fCited by top-tier papers6
- ROMA: Multi-Agent Reinforcement Learning with Emergent RolesTonghan Wang, Heng Dong, Victor R. Lesser, Chongjie ZhangICML 2020 · 286 citations
- A Framework for Learning to Request Rich and Contextually Useful Information from HumansKhanh X. Nguyen, Yonatan Bisk, Hal Daumé IIIICML 2022 · 21 citations
- Iterative Teacher-Aware LearningLuyao Yuan, Dongruo Zhou, Junhong Shen, Jingdong Gao et al.NeurIPS 2021 · 15 citations
- Multi-Sender Persuasion: A Computational PerspectiveSafwan Hossain, Tonghan Wang, Tao Lin, Yiling Chen et al.ICML 2024 · 14 citations
- Translate Policy to Language: Flow Matching Generated Rewards for LLM ExplanationsXinyi Yang, Liang Zeng, Heng Dong, Chao Yu et al.ICLR 2026 · 6 citations
Builds on5
- Learning Nearly Decomposable Value Functions Via Communication MinimizationTonghan Wang, Jianhao Wang, Chongyi Zheng, Chongjie ZhangICLR 2020 · 170 citations
- Shapeglot: Learning Language for Shape DifferentiationPanos Achlioptas, Leonidas J. Guibas, Noah D. Goodman, Judy Fan et al.ICCV 2019 · 86 citations
- A mathematical theory of cooperative communicationPei Wang, Junqi Wang, Pushpi Paranamana, Patrick ShaftoNeurIPS 2020 · 54 citations
- Joint Optimization for Cooperative Image CaptioningGilad Vered, Gal Oren, Yuval Atzmon, Gal ChechikICCV 2019 · 21 citations
- Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language LearningAngeliki Lazaridou, Anna Potapenko, Olivier TielemanACL 2020 · 11 citations
Related papers
- Learning Multi-Object Positional Relationships via Emergent CommunicationYicheng Feng, Boshi An, Zongqing LuAAAI 2024 · 4 citations
- Speaking Your Language: Spatial Relationships in Interpretable Emergent CommunicationOlaf Lipinski, Adam J. Sobey, Federico Cerutti, Timothy J. NormanNeurIPS 2024 · 5 citations
- The Grammar of Emergent LanguagesOskar van der Wal, Silvan de Boer, Elia Bruni, Dieuwke HupkesEMNLP 2020
- Revisiting Populations in multi-agent CommunicationPaul Michel, Mathieu Rita, Kory Wallace Mathewson, Olivier Tieleman et al.ICLR 2023
- Emergent Communication of GeneralizationsJesse Mu, Noah D. GoodmanNeurIPS 2021 · 60 citations
