Lune

ACL Findings2025

Lemmatisation & Morphological Analysis of Unedited Greek: Do Simple Tasks Need Complex Solutions?

Colin Swaelens, Ilse De Vos, Els Lefever

Abstract

Fine-tuning transformer-based models for partof-speech tagging of unedited Greek text has outperformed traditional systems. However, when applied to lemmatisation or morphological analysis, fine-tuning has not yet achieved competitive results. This paper explores various approaches to combine morphological features to both reduce label complexity and enhance multi-task training. Specifically, we group three nominal features into a single label, and combine the three most distinctive features of verbs into another unified label. These combined labels are used to fine-tune DBBERT, a BERT model pre-trained on both ancient and modern Greek. Additionally, we experiment with joint training -both among these labels and in combination with POS taggingwithin a multi-task framework to improve performance by transferring parameters. To evaluate our models, we use a manually annotated gold standard from the Database of Byzantine Book Epigrams. Our results show a nearly 9 pp. improvement, demonstrating that multi-task learning is a promising approach for linguistic annotation in less standardised corpora.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on1

  1. Exploring Large Language Models for Classical PhilologyFrederick Riemenschneider, Anette FrankACL 2023 · 8 citations

Related papers

  1. One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksSebastian Nehrdich, Oliver Hellwig, Kurt KeutzerEMNLP Findings 2024 · 12 citations
  2. Detecting Erroneously Recognized Handwritten Byzantine TextJohn Pavlopoulos, Vasiliki Kougia, Paraskevi Platanou, Holger EsslerEMNLP Findings 2023 · 1 citation
  3. Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its DialectsGo Inoue, Salam Khalifa, Nizar HabashACL Findings 2022 · 23 citations
  4. LIMIT-BERT : Linguistics Informed Multi-Task BERTJunru Zhou, Zhuosheng Zhang, Hai Zhao, Shuailiang ZhangEMNLP Findings 2020 · 44 citations
  5. To POS Tag or Not to POS Tag: The Impact of POS Tags on Morphological Learning in Low-Resource SettingsSarah R. Moeller, Ling Liu, Mans HuldenACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines