Variational Graph Autoencoding as Cheap Supervision for AMR Coreference Resolution
Irene Li, Linfeng Song, Kun Xu, Dong Yu
Abstract
Coreference resolution over semantic graphs like AMRs aims to group the graph nodes that represent the same entity. This is a crucial step for making document-level formal semantic representations. With annotated data on AMR coreference resolution, deep learning approaches have recently shown great potential for this task, yet they are usually data hungry and annotating data is costly. We propose a general pretraining method using variational graph autoencoder (VGAE) for AMR coreference resolution, which can leverage any general AMR corpus and even automatically parsed AMR data. Experiments on benchmarks show that the pretraining approach achieves performance gains of up to 6% absolute F1 points. Moreover, our model significantly improves on the previous state-of-theart model by up to 11% F1 points.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 92b0cefe-5850-4d27-9487-8065c7e3d423Builds on7
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Graph Transformer for Graph-to-Sequence LearningDeng Cai, Wai LamAAAI 2020 · 247 citations
- JAKET: Joint Pre-training of Knowledge Graph and Language UnderstandingDonghan Yu, Chenguang Zhu, Yiming Yang, Michael ZengAAAI 2022 · 171 citations
- Structural Information Preserving for Graph-to-Text GenerationLinfeng Song, Ante Wang, Jinsong Su, Yue Zhang et al.ACL 2020 · 45 citations
- AMR Parsing with Latent Structural InformationQiji Zhou, Yue Zhang, Donghong Ji, Hao TangACL 2020 · 29 citations
Related papers
- Graph Pre-training for AMR Parsing and GenerationXuefeng Bai, Yulong Chen, Yue ZhangACL 2022
- Improving AMR Parsing with Sequence-to-Sequence Pre-trainingDongqin Xu, Junhui Li, Muhua Zhu, Min Zhang et al.EMNLP 2020 · 57 citations
- Cost-effective Variational Active Entity ResolutionAlex Bogatu, Norman W. Paton, Mark Douthwaite, Stuart Davie et al.ICDE 2021 · 12 citations
- A Differentiable Relaxation of Graph Segmentation and Alignment for AMR ParsingChunchuan Lyu, Shay B. Cohen, Ivan TitovEMNLP 2021 · 13 citations
- CLEVE: Contrastive Pre-training for Event ExtractionZiqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin et al.ACL 2021
