Lune

EMNLP Findings2023

Guiding AMR Parsing with Reverse Graph Linearization

Bofei Gao, Liang Chen, Peiyi Wang, Zhifang Sui, Baobao Chang

摘要

Meaning Representation (AMR) parsing aims to extract an abstract semantic graph from a given sentence.The sequenceto-sequence approaches, which linearize the semantic graph into a sequence of nodes and edges and generate the linearized graph directly, have achieved good performance.However, we observed that these approaches suffer from structure loss accumulation during the decoding process, leading to a much lower F1-score for nodes and edges decoded later compared to those decoded earlier.To address this issue, we propose a novel Reverse Graph Linearization (RGL) enhanced framework.RGL defines both default and reverse linearization orders of an AMR graph, where most structures at the back part of the default order appear at the front part of the reversed order and vice versa.RGL incorporates the reversed linearization to the original AMR parser through a two-pass self-distillation mechanism, which guides the model when generating the default linearizations.Our analysis shows that our proposed method significantly mitigates the problem of structure loss accumulation, outperforming the previously best AMR parsing model by 0.8 and 0.5 Smatch scores on the AMR 2.0 and AMR 3.0 dataset, respectively.The code are available at https: //github.com/pkunlp-icler/AMR_ reverse_graph_linearization.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 引用它的 1 篇顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

引用它的顶会 Paper1

  1. Integrating Structural Semantic Knowledge for Enhanced Information Extraction Pre-trainingXiaoyang Yi, Yuru Bao, Jian Zhang, Yifang Qin 等EMNLP 2024 · 1 次引用

它引用的 Paper13

  1. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad 等ACL 2020 · 1,224 次引用
  2. Scalable Zero-shot Entity Linking with Dense Entity RetrievalLedell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel 等EMNLP 2020 · 336 次引用
  3. One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex PipelineMichele Bevilacqua, Rexhina Blloshmi, Roberto NavigliAAAI 2021 · 197 次引用
  4. Curriculum Learning for Natural Language UnderstandingBenfeng Xu, Licheng Zhang, Zhendong Mao, Quan Wang 等ACL 2020 · 156 次引用
  5. AMR Parsing via Graph-Sequence Iterative InferenceDeng Cai, Wai LamACL 2020 · 83 次引用

相关 Paper

  1. Incorporating Graph Information in Transformer-based AMR ParsingPavlo Vasylenko, Pere-Lluís Huguet Cabot, Abelardo Carlos Martinez Lorenzo, Roberto NavigliACL Findings 2023 · 7 次引用
  2. Improving AMR Parsing with Sequence-to-Sequence Pre-trainingDongqin Xu, Junhui Li, Muhua Zhu, Min Zhang 等EMNLP 2020 · 57 次引用
  3. Stacked AMR Parsing with Silver DataQingrong Xia, Zhenghua Li, Rui Wang, Min ZhangEMNLP Findings 2021 · 5 次引用
  4. Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR ParsingJiawei Zhou, Tahira Naseem, Ramón Fernandez Astudillo, Young-Suk Lee 等EMNLP 2021 · 27 次引用
  5. Graph Pre-training for AMR Parsing and GenerationXuefeng Bai, Yulong Chen, Yue ZhangACL 2022
黄昏的海面,两侧是细线勾勒的悬崖