Lune

EMNLP Findings2023

Guiding AMR Parsing with Reverse Graph Linearization

Bofei Gao, Liang Chen, Peiyi Wang, Zhifang Sui, Baobao Chang

Abstract

Meaning Representation (AMR) parsing aims to extract an abstract semantic graph from a given sentence.The sequenceto-sequence approaches, which linearize the semantic graph into a sequence of nodes and edges and generate the linearized graph directly, have achieved good performance.However, we observed that these approaches suffer from structure loss accumulation during the decoding process, leading to a much lower F1-score for nodes and edges decoded later compared to those decoded earlier.To address this issue, we propose a novel Reverse Graph Linearization (RGL) enhanced framework.RGL defines both default and reverse linearization orders of an AMR graph, where most structures at the back part of the default order appear at the front part of the reversed order and vice versa.RGL incorporates the reversed linearization to the original AMR parser through a two-pass self-distillation mechanism, which guides the model when generating the default linearizations.Our analysis shows that our proposed method significantly mitigates the problem of structure loss accumulation, outperforming the previously best AMR parsing model by 0.8 and 0.5 Smatch scores on the AMR 2.0 and AMR 3.0 dataset, respectively.The code are available at https: //github.com/pkunlp-icler/AMR_ reverse_graph_linearization.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. Integrating Structural Semantic Knowledge for Enhanced Information Extraction Pre-trainingXiaoyang Yi, Yuru Bao, Jian Zhang, Yifang Qin et al.EMNLP 2024 · 1 citation

Builds on13

  1. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
  2. Scalable Zero-shot Entity Linking with Dense Entity RetrievalLedell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel et al.EMNLP 2020 · 336 citations
  3. One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex PipelineMichele Bevilacqua, Rexhina Blloshmi, Roberto NavigliAAAI 2021 · 197 citations
  4. Curriculum Learning for Natural Language UnderstandingBenfeng Xu, Licheng Zhang, Zhendong Mao, Quan Wang et al.ACL 2020 · 156 citations
  5. AMR Parsing via Graph-Sequence Iterative InferenceDeng Cai, Wai LamACL 2020 · 83 citations

Related papers

  1. Incorporating Graph Information in Transformer-based AMR ParsingPavlo Vasylenko, Pere-Lluís Huguet Cabot, Abelardo Carlos Martinez Lorenzo, Roberto NavigliACL Findings 2023 · 7 citations
  2. Improving AMR Parsing with Sequence-to-Sequence Pre-trainingDongqin Xu, Junhui Li, Muhua Zhu, Min Zhang et al.EMNLP 2020 · 57 citations
  3. Stacked AMR Parsing with Silver DataQingrong Xia, Zhenghua Li, Rui Wang, Min ZhangEMNLP Findings 2021 · 5 citations
  4. Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR ParsingJiawei Zhou, Tahira Naseem, Ramón Fernandez Astudillo, Young-Suk Lee et al.EMNLP 2021 · 27 citations
  5. Graph Pre-training for AMR Parsing and GenerationXuefeng Bai, Yulong Chen, Yue ZhangACL 2022
Dusk over the sea between two cliffs drawn in fine vertical lines