EMNLP Findings2023
Diversifying language models for lesser-studied languages and language-usage contexts: A case of second language Korean
Hakyung Sung, Gyu-Ho Shin
摘要
This study investigates the extent to which currently available morpheme parsers/taggers apply to lesser-studied languages and languageusage contexts, specifically focusing on second language (L2) Korean. We pursue this inquiry by (1) training a neural-network model (pretrained on first language [L1] Korean data) on varying L2 datasets and (2) measuring its morpheme parsing/tagging performance on L2 test sets from both the same and different sources of L2 training sets. The results show that the L2 trained models generally excel in L2 domainspecific parsing and tagging tasks compared to the L1 pre-trained baseline model. Interestingly, increasing the size of L2 training data does not lead to improving model performance consistently.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper1
相关 Paper
- Beyond Distribution: Investigating Language Models' Understanding of Sino-Korean MorphemesTaehee JeonEMNLP Findings 2025
- Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 次引用
- Another Dead End for Morphological Tags? Perturbed Inputs and ParsingAlberto Muñoz-Ortiz, David VilaresACL Findings 2023
- MorphBPE: Morphology-Aware Tokenization for Efficient LLM TrainingEhsaneddin Asgari, Yassine El Kheir, MohammadAli SadraeiJavaheri, Ali NazariACL Findings 2026
- Exploring morphology-aware tokenization: A case study on Spanish language modelingAlba Táboas García, Piotr Przybyla, Leo WannerEMNLP 2025 · 1 次引用
