Lune

EMNLP Findings2023

Diversifying language models for lesser-studied languages and language-usage contexts: A case of second language Korean

Hakyung Sung, Gyu-Ho Shin

摘要

This study investigates the extent to which currently available morpheme parsers/taggers apply to lesser-studied languages and languageusage contexts, specifically focusing on second language (L2) Korean. We pursue this inquiry by (1) training a neural-network model (pretrained on first language [L1] Korean data) on varying L2 datasets and (2) measuring its morpheme parsing/tagging performance on L2 test sets from both the same and different sources of L2 training sets. The results show that the L2 trained models generally excel in L2 domainspecific parsing and tagging tasks compared to the L1 pre-trained baseline model. Interestingly, increasing the size of L2 training data does not lead to improving model performance consistently.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper1

  1. The State and Fate of Linguistic Diversity and Inclusion in the NLP WorldPratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali 等ACL 2020 · 40 次引用

相关 Paper

  1. Beyond Distribution: Investigating Language Models' Understanding of Sino-Korean MorphemesTaehee JeonEMNLP Findings 2025
  2. Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 次引用
  3. Another Dead End for Morphological Tags? Perturbed Inputs and ParsingAlberto Muñoz-Ortiz, David VilaresACL Findings 2023
  4. MorphBPE: Morphology-Aware Tokenization for Efficient LLM TrainingEhsaneddin Asgari, Yassine El Kheir, MohammadAli SadraeiJavaheri, Ali NazariACL Findings 2026
  5. Exploring morphology-aware tokenization: A case study on Spanish language modelingAlba Táboas García, Piotr Przybyla, Leo WannerEMNLP 2025 · 1 次引用
黄昏的海面,两侧是细线勾勒的悬崖