Global Greedy Dependency Parsing
Zuchao Li, Hai Zhao, Kevin Parnow
Abstract
Most syntactic dependency parsing models may fall into one of two categories: transition- and graph-based models. The former models enjoy high inference efficiency with linear time complexity, but they rely on the stacking or re-ranking of partially-built parse trees to build a complete parse tree and are stuck with slower training for the necessity of dynamic oracle training. The latter, graph-based models, may boast better performance but are unfortunately marred by polynomial time inference. In this paper, we propose a novel parsing order objective, resulting in a novel dependency parsing model capable of both global (in sentence scope) feature extraction as in graph models and linear time inference as in transitional models. The proposed global greedy parser only uses two arc-building actions, left and right arcs, for projective parsing. When equipped with two extra non-projective arc-building actions, the proposed parser may also smoothly support non-projective parsing. Using multiple benchmark treebanks, including the Penn Treebank (PTB), the CoNLL-X treebanks, and the Universal Dependency Treebanks, we evaluate our parser and demonstrate that the proposed novel parser achieves good performance with faster training and decoding.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Span Model for Open Information Extraction on Accurate CorpusJunlang Zhan, Hai ZhaoAAAI 2020 · 90 citations
- Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn DialogueLongxiang Liu, Zhuosheng Zhang, Hai Zhao, Xi Zhou et al.AAAI 2021 · 57 citations
- Mastering the Explicit Opinion-Role Interaction: Syntax-Aided Neural Transition System for Unified Opinion Role LabelingShengqiong Wu, Hao Fei, Fei Li, Meishan Zhang et al.AAAI 2022 · 40 citations
- Automated Concatenation of Embeddings for Structured PredictionXinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang et al.ACL 2021
Builds on2
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
Related papers
- Headed-Span-Based Projective Dependency ParsingSonglin Yang, Kewei TuACL 2022 · 16 citations
- Dependency Graph Parsing as Sequence LabelingAna Ezquerro, David Vilares, Carlos Gómez-RodríguezEMNLP 2024 · 1 citation
- Strongly Incremental Constituency Parsing with Graph Neural NetworksKaiyu Yang, Jia DengNeurIPS 2020 · 41 citations
- Fast semantic parsing with well-typedness guaranteesMatthias Lindemann, Jonas Groschwitz, Alexander KollerEMNLP 2020 · 2 citations
- Transition-based Semantic Dependency Parsing with Pointer NetworksDaniel Fernández-González, Carlos Gómez-RodríguezACL 2020 · 4 citations
