ACL Findings2025
Lemmatisation & Morphological Analysis of Unedited Greek: Do Simple Tasks Need Complex Solutions?
Colin Swaelens, Ilse De Vos, Els Lefever
Abstract
Fine-tuning transformer-based models for partof-speech tagging of unedited Greek text has outperformed traditional systems. However, when applied to lemmatisation or morphological analysis, fine-tuning has not yet achieved competitive results. This paper explores various approaches to combine morphological features to both reduce label complexity and enhance multi-task training. Specifically, we group three nominal features into a single label, and combine the three most distinctive features of verbs into another unified label. These combined labels are used to fine-tune DBBERT, a BERT model pre-trained on both ancient and modern Greek. Additionally, we experiment with joint training -both among these labels and in combination with POS taggingwithin a multi-task framework to improve performance by transferring parameters. To evaluate our models, we use a manually annotated gold standard from the Database of Byzantine Book Epigrams. Our results show a nearly 9 pp. improvement, demonstrating that multi-task learning is a promising approach for linguistic annotation in less standardised corpora.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on1
Related papers
- One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksSebastian Nehrdich, Oliver Hellwig, Kurt KeutzerEMNLP Findings 2024 · 12 citations
- Detecting Erroneously Recognized Handwritten Byzantine TextJohn Pavlopoulos, Vasiliki Kougia, Paraskevi Platanou, Holger EsslerEMNLP Findings 2023 · 1 citation
- Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 citations
- LIMIT-BERT : Linguistics Informed Multi-Task BERTJunru Zhou, Zhuosheng Zhang, Hai Zhao, Shuailiang ZhangEMNLP Findings 2020 · 44 citations
- To POS Tag or Not to POS Tag: The Impact of POS Tags on Morphological Learning in Low-Resource SettingsSarah R. Moeller, Ling Liu, Mans HuldenACL 2021
