Lune

ACL Findings2022

Dim Wihl Gat Tun: The Case for Linguistic Expertise in NLP for Under-Documented Languages

Clarissa Forbes, Farhan Samir, Bruce Harold Oliver, Changbing Yang, Edith Coates, Garrett Nicolai, Miikka Silfverberg

Abstract

Recent progress in NLP is driven by pretrained models leveraging massive datasets and has predominantly benefited the world's political and economic superpowers. Technologically underserved languages are left behind because they lack such resources. Hundreds of underserved languages, nevertheless, have available data sources in the form of interlinear glossed text (IGT) from language documentation efforts. IGT remains underutilized in NLP work, perhaps because its annotations are only semistructured and often language-specific. With this paper, we make the case that IGT data can be leveraged successfully provided that target language expertise is available. We specifically advocate for collaboration with documentary linguists. Our paper provides a roadmap for successful projects utilizing IGT data: (1) It is essential to define which NLP tasks can be accomplished with the given IGT data and how these will benefit the speech community.

(2) Great care and target language expertise is required when converting the data into structured formats commonly employed in NLP. (3) Task-specific and user-specific evaluation can help to ascertain that the tools which are created benefit the target language speech community. We illustrate each step through a case study on developing a morphological reinflection system for the Tsimchianic language Gitksan.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Interdisciplinary Research in Conversation: A Case Study in Computational Morphology for Language Documentation cites IGT2P: From Interlinear Glossed Texts to Paradigms
  • How Linguistically Fair Are Multilingual Pre-Trained Language Models? cites The State and Fate of Linguistic Diversity and Inclusion in the NLP World
  • OCR Post Correction for Endangered Language Texts cites The State and Fate of Linguistic Diversity and Inclusion in the NLP World
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Interdisciplinary Research in Conversation: A Case Study in Computational Morphology for Language DocumentationEnora Rice, Katharina von der Wense, Alexis PalmerEMNLP 2025

Builds on7

  1. How Linguistically Fair Are Multilingual Pre-Trained Language Models?Monojit Choudhury, Amit DeshpandeAAAI 2021 · 59 citations
  2. The State and Fate of Linguistic Diversity and Inclusion in the NLP WorldPratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali et al.ACL 2020 · 40 citations
  3. IGT2P: From Interlinear Glossed Texts to ParadigmsSarah R. Moeller, Ling Liu, Changbing Yang, Katharina Kann et al.EMNLP 2020 · 13 citations
  4. OCR Post Correction for Endangered Language TextsShruti Rijhwani, Antonios Anastasopoulos, Graham NeubigEMNLP 2020 · 1 citation
  5. Bootstrapping Techniques for Polysynthetic Morphological AnalysisWilliam Lane, Steven BirdACL 2020

Related papers

  1. GlossLM: A Massively Multilingual Corpus and Pretrained Model for Interlinear Glossed TextMichael Ginn, Lindia Tjuatja, Taiqi He, Enora Rice et al.EMNLP 2024 · 1 citation
  2. Can we teach language models to gloss endangered languages?Michael Ginn, Mans Hulden, Alexis PalmerEMNLP Findings 2024 · 2 citations
  3. Multiple Sources are Better Than One: Incorporating External Knowledge in Low-Resource GlossingChangbing Yang, Garrett Nicolai, Miikka SilfverbergEMNLP 2024
  4. Towards Multilingual Interlinear Morphological GlossingShu Okabe, François YvonEMNLP Findings 2023
  5. Wav2Gloss: Generating Interlinear Glossed Text from SpeechTaiqi He, Kwanghee Choi, Lindia Tjuatja, Nathaniel R. Robinson et al.ACL 2024 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines