Morpheme Induction for Emergent Language
Brendon Boldt, David R. Mortensen
Abstract
We introduce CSAR, an algorithm for inducing morphemes from emergent language corpora of parallel utterances and meanings. It is a greedy algorithm that (1) weights morphemes based on mutual information between forms and meanings, (2) selects the highest-weighted pair, (3) removes it from the corpus, and (4) repeats the process to induce further morphemes (i.e., Count, Select, Ablate, Repeat). The effectiveness of CSAR is first validated on procedurally generated datasets and compared against baselines for related tasks. Second, we validate CSAR's performance on human language data to show that the algorithm makes reasonable predictions in adjacent domains. Finally, we analyze a handful of emergent languages, quantifying linguistic characteristics like degree of synonymy and polysemy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5250fab8-06b4-411a-a05f-dc0558aa0011Cited by top-tier papers1
Ask how each one uses itBuilds on3
- Emergent Communication of GeneralizationsJesse Mu, Noah D. GoodmanNeurIPS 2021 · 60 citations
- Speaking Your Language: Spatial Relationships in Interpretable Emergent CommunicationOlaf Lipinski, Adam J. Sobey, Federico Cerutti, Timothy J. NormanNeurIPS 2024 · 5 citations
- The Grammar of Emergent LanguagesOskar van der Wal, Silvan de Boer, Elia Bruni, Dieuwke HupkesEMNLP 2020
Related papers
- Linking Emergent and Natural Languages via Corpus TransferShunyu Yao, Mo Yu, Yang Zhang, Karthik R. Narasimhan et al.ICLR 2022 · 20 citations
- Bootstrapping Techniques for Polysynthetic Morphological AnalysisWilliam Lane, Steven BirdACL 2020
- Quantifying Semantic Emergence in Language ModelsHang Chen, Xinyu Yang, Jiaying Zhu, Wenya WangACL 2025
- CaMEL: Case Marker Extraction without LabelsLeonie Weissweiler, Valentin Hofmann, Masoud Jalili Sabet, Hinrich SchützeACL 2022 · 3 citations
- Massively Multilingual Sparse Word RepresentationsGábor BerendICLR 2020 · 2 citations
