One SPRING to Rule Them Both: Symmetric AMR Semantic Parsing and Generation without a Complex Pipeline
Michele Bevilacqua, Rexhina Blloshmi, Roberto Navigli
摘要
In Text-to-AMR parsing, current state-of-the-art semantic parsers use cumbersome pipelines integrating several different modules or components, and exploit graph recategorization, i.e., a set of content-specific heuristics that are developed on the basis of the training set. However, the generalizability of graph recategorization in an out-of-distribution setting is unclear. In contrast, state-of-the-art AMR-to-Text generation, which can be seen as the inverse to parsing, is based on simpler seq2seq. In this paper, we cast Text-to-AMR and AMR-to-Text as a symmetric transduction task and show that by devising a careful graph linearization and extending a pretrained encoder-decoder model, it is possible to obtain state-of-the-art performances in both tasks using the very same seq2seq approach, i.e., SPRING (Symmetric PaRsIng aNd Generation). Our model does not require complex pipelines, nor heuristics built on heavy assumptions. In fact, we drop the need for graph recategorization, showing that this technique is actually harmful outside of the standard benchmark. Finally, we outperform the previous state of the art on the English AMR 2.0 dataset by a large margin: on Text-to-AMR we obtain an improvement of 3.6 Smatch points, while on AMR-to-Text we outperform the state of the art by 11.2 BLEU points. We release the software at github.com/SapienzaNLP/spring.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper18
- Ensembling Graph Predictions for AMR ParsingThanh Lam Hoang, Gabriele Picco, Yufang Hou, Young-Suk Lee 等NeurIPS 2021 · 被引用 29 次
- Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR ParsingJiawei Zhou, Tahira Naseem, Ramón Fernandez Astudillo, Young-Suk Lee 等EMNLP 2021 · 被引用 27 次
- AMPERE: AMR-Aware Prefix for Generation-Based Event Argument Extraction ModelI-Hung Hsu, Zhiyu Xie, Kuan-Hao Huang, Prem Natarajan 等ACL 2023 · 被引用 26 次
- AMR-based Network for Aspect-based Sentiment AnalysisFukun Ma, Xuming Hu, Aiwei Liu, Yawen Yang 等ACL 2023 · 被引用 23 次
- Cogito Ergo Summ: Abstractive Summarization of Biomedical Papers via Semantic Parsing Graphs and Consistency RewardsGiacomo Frisoni, Paolo Italiani, Stefano Salvatori, Gianluca MoroAAAI 2023 · 被引用 21 次
它引用的顶会 Paper11
- On the Variance of the Adaptive Learning Rate and BeyondLiyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen 等ICLR 2020 · 被引用 2,210 次
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad 等ACL 2020 · 被引用 1,224 次
- Scalable Zero-shot Entity Linking with Dense Entity RetrievalLedell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel 等EMNLP 2020 · 被引用 336 次
- Graph Transformer for Graph-to-Sequence LearningDeng Cai, Wai LamAAAI 2020 · 被引用 247 次
- AMR Parsing via Graph-Sequence Iterative InferenceDeng Cai, Wai LamACL 2020 · 被引用 83 次
相关 Paper
- Improving AMR Parsing with Sequence-to-Sequence Pre-trainingDongqin Xu, Junhui Li, Muhua Zhu, Min Zhang 等EMNLP 2020 · 被引用 57 次
- Online Back-Parsing for AMR-to-Text GenerationXuefeng Bai, Linfeng Song, Yue ZhangEMNLP 2020 · 被引用 17 次
- Compositional Generalization without Trees using Multiset Tagging and Latent PermutationsMatthias Lindemann, Alexander Koller, Ivan TitovACL 2023
- Graph Pre-training for AMR Parsing and GenerationXuefeng Bai, Yulong Chen, Yue ZhangACL 2022
- XLPT-AMR: Cross-Lingual Pre-Training via Multi-Task Learning for Zero-Shot AMR Parsing and Text GenerationDongqin Xu, Junhui Li, Muhua Zhu, Min Zhang 等ACL 2021
