EMNLP Findings2023
Diversifying language models for lesser-studied languages and language-usage contexts: A case of second language Korean
Hakyung Sung, Gyu-Ho Shin
Abstract
This study investigates the extent to which currently available morpheme parsers/taggers apply to lesser-studied languages and languageusage contexts, specifically focusing on second language (L2) Korean. We pursue this inquiry by (1) training a neural-network model (pretrained on first language [L1] Korean data) on varying L2 datasets and (2) measuring its morpheme parsing/tagging performance on L2 test sets from both the same and different sources of L2 training sets. The results show that the L2 trained models generally excel in L2 domainspecific parsing and tagging tasks compared to the L1 pre-trained baseline model. Interestingly, increasing the size of L2 training data does not lead to improving model performance consistently.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on1
Related papers
- Beyond Distribution: Investigating Language Models' Understanding of Sino-Korean MorphemesTaehee JeonEMNLP Findings 2025
- Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 citations
- Another Dead End for Morphological Tags? Perturbed Inputs and ParsingAlberto Muñoz-Ortiz, David VilaresACL Findings 2023
- MorphBPE: Morphology-Aware Tokenization for Efficient LLM TrainingEhsaneddin Asgari, Yassine El Kheir, MohammadAli SadraeiJavaheri, Ali NazariACL Findings 2026
- Exploring morphology-aware tokenization: A case study on Spanish language modelingAlba Táboas García, Piotr Przybyla, Leo WannerEMNLP 2025 · 1 citation
