Lemmatization as a Classification Task: Results from Arabic across Multiple Genres
Mostafa Saeed, Nizar Habash
摘要
Lemmatization is crucial for NLP tasks in morphologically rich languages with ambiguous orthography like Arabic, but existing tools face challenges due to inconsistent standards and limited genre coverage. This paper introduces two novel approaches that frame lemmatization as classification into a Lemma-POS-Gloss (LPG) tagset, leveraging machine translation and semantic clustering. We also present a new Arabic lemmatization test set covering diverse genres, standardized alongside existing datasets. We evaluate character-level sequenceto-sequence models, which perform competitively and offer complementary value, but are limited to lemma prediction (not LPG) and prone to hallucinating implausible forms. Our results show that classification and clustering yield more robust, interpretable outputs, setting new benchmarks for Arabic lemmatization. B License In Table 12 , we list the license of the data and tools used in this work. All of them are used under their intended use.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
相关 Paper
- Joint Diacritization, Lemmatization, Normalization, and Fine-Grained Morphological TaggingNasser Zalmout, Nizar HabashACL 2020 · 被引用 3 次
- Advancements in Arabic Grammatical Error Detection and Correction: An Empirical InvestigationBashar Alhafni, Go Inoue, Christian Khairallah, Nizar HabashEMNLP 2023 · 被引用 10 次
- AraT5: Text-to-Text Transformers for Arabic Language GenerationEl Moatez Billah Nagoudi, AbdelRahim A. Elmadany, Muhammad Abdul-MageedACL 2022 · 被引用 175 次
- TAMS: Translation-Assisted Morphological SegmentationEnora Rice, Ali Marashian, Luke Gessler, Alexis Palmer 等ACL 2024
- Transforming Sequence Tagging Into A Seq2Seq TaskKarthik Raman, Iftekhar Naim, Jiecao Chen, Kazuma Hashimoto 等EMNLP 2022 · 被引用 12 次
