EMNLP Findings2023
Guiding AMR Parsing with Reverse Graph Linearization
Bofei Gao, Liang Chen, Peiyi Wang, Zhifang Sui, Baobao Chang
Abstract
Meaning Representation (AMR) parsing aims to extract an abstract semantic graph from a given sentence.The sequenceto-sequence approaches, which linearize the semantic graph into a sequence of nodes and edges and generate the linearized graph directly, have achieved good performance.However, we observed that these approaches suffer from structure loss accumulation during the decoding process, leading to a much lower F1-score for nodes and edges decoded later compared to those decoded earlier.To address this issue, we propose a novel Reverse Graph Linearization (RGL) enhanced framework.RGL defines both default and reverse linearization orders of an AMR graph, where most structures at the back part of the default order appear at the front part of the reversed order and vice versa.RGL incorporates the reversed linearization to the original AMR parser through a two-pass self-distillation mechanism, which guides the model when generating the default linearizations.Our analysis shows that our proposed method significantly mitigates the problem of structure loss accumulation, outperforming the previously best AMR parsing model by 0.8 and 0.5 Smatch scores on the AMR 2.0 and AMR 3.0 dataset, respectively.The code are available at https: //github.com/pkunlp-icler/AMR_ reverse_graph_linearization.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on13
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Scalable Zero-shot Entity Linking with Dense Entity RetrievalLedell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel et al.EMNLP 2020 · 336 citations
- One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex PipelineMichele Bevilacqua, Rexhina Blloshmi, Roberto NavigliAAAI 2021 · 197 citations
- Curriculum Learning for Natural Language UnderstandingBenfeng Xu, Licheng Zhang, Zhendong Mao, Quan Wang et al.ACL 2020 · 156 citations
- AMR Parsing via Graph-Sequence Iterative InferenceDeng Cai, Wai LamACL 2020 · 83 citations
Related papers
- Incorporating Graph Information in Transformer-based AMR ParsingPavlo Vasylenko, Pere-Lluís Huguet Cabot, Abelardo Carlos Martinez Lorenzo, Roberto NavigliACL Findings 2023 · 7 citations
- Improving AMR Parsing with Sequence-to-Sequence Pre-trainingDongqin Xu, Junhui Li, Muhua Zhu, Min Zhang et al.EMNLP 2020 · 57 citations
- Stacked AMR Parsing with Silver DataQingrong Xia, Zhenghua Li, Rui Wang, Min ZhangEMNLP Findings 2021 · 5 citations
- Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR ParsingJiawei Zhou, Tahira Naseem, Ramón Fernandez Astudillo, Young-Suk Lee et al.EMNLP 2021 · 27 citations
- Graph Pre-training for AMR Parsing and GenerationXuefeng Bai, Yulong Chen, Yue ZhangACL 2022
