Lune

ACL Findings2024

MRL Parsing Without Tears: The Case of Hebrew

Shaltiel Shmidman, Avi Shmidman, Moshe Koppel, Reut Tsarfaty

Abstract

Syntactic parsing remains a critical tool for relation extraction and information extraction, especially in resource-scarce languages where LLMs are lacking. Yet in morphologically rich languages (MRLs), where parsers need to identify multiple lexical units in each token, existing systems suffer in latency and setup complexity. Some use a pipeline to peel away the layers: first segmentation, then morphology tagging, and then syntax parsing; however, errors in earlier layers are then propagated forward. Others use a joint architecture to evaluate all permutations at once; while this improves accuracy, it is notoriously slow. In contrast, and taking Hebrew as a test case, we present a new "flipped pipeline": decisions are made directly on the whole-token units by expert classifiers, each one dedicated to one specific task. The classifier predictions are independent of one another, and only at the end do we synthesize their predictions. This blazingly fast approach requires only a single huggingface call, without the need for recourse to lexicons or linguistic resources. When trained on the same training set used in previous studies, our model achieves near-SOTA performance on a wide array of Hebrew NLP tasks. Furthermore, when trained on a newly enlarged training corpus, our model achieves a new SOTA for Hebrew POS tagging and dependency parsing. We release this new SOTA model to the community. Because our architecture does not rely on any languagespecific resources, it can serve as a model to develop similar parsers for other MRLs.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on2

  1. A Pointer Network Architecture for Joint Morphological Segmentation and TaggingAmit Seker, Reut TsarfatyEMNLP Findings 2020 · 9 citations
  2. Multilingual Sequence-to-Sequence Models for Hebrew NLPMatan Eyal, Hila Noga, Roee Aharoni, Idan Szpektor et al.ACL Findings 2023 · 5 citations

Related papers

  1. From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)?Reut Tsarfaty, Dan Bareket, Stav Klein, Amit SekerACL 2020 · 2 citations
  2. AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence LevelAmit Seker, Elron Bandel, Dan Bareket, Idan Brusilovsky et al.ACL 2022 · 53 citations
  3. A Novel Challenge Set for Hebrew Morphological Disambiguation and Diacritics RestorationAvi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Moshe Koppel et al.EMNLP Findings 2020 · 3 citations
  4. HeQ: a Large and Diverse Hebrew Reading Comprehension BenchmarkAmir David Nissan Cohen, Hilla Merhav, Yoav Goldberg, Reut TsarfatyEMNLP Findings 2023 · 2 citations
  5. Splintering Nonconcatenative Languages for Better TokenizationBar Gazit, Shaltiel Shmidman, Avi Shmidman, Yuval PinterACL Findings 2025 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines