Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings
Shaopeng Lai, Ante Wang, Fandong Meng, Jie Zhou, Yubin Ge, Jiali Zeng, Junfeng Yao, Degen Huang, Jinsong Su
Abstract
Dominant sentence ordering models can be classified into pairwise ordering models and set-to-sequence models. However, there is little attempt to combine these two types of models, which inituitively possess complementary advantages. In this paper, we propose a novel sentence ordering framework which introduces two classifiers to make better use of pairwise orderings for graph-based sentence ordering (Yin et al., 2019 (Yin et al., , 2021)) . Specially, given an initial sentence-entity graph, we first introduce a graph-based classifier to predict pairwise orderings between linked sentences. Then, in an iterative manner, based on the graph updated by previously predicted highconfident pairwise orderings, another classifier is used to predict the remaining uncertain pairwise orderings. At last, we adapt a GRN-based sentence ordering model (Yin et al., 2019 (Yin et al., , 2021) ) on the basis of final graph. Experiments on five commonly-used datasets demonstrate the effectiveness and generality of our model. Particularly, when equipped with BERT (Devlin et al., 2019) and FHDecoder (Yin et al., 2020), our model achieves state-of-the-art performance. Our code is available at https:// github.com/DeepLearnXMU/IRSEG .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Towards Better Document-level Relation Extraction via Iterative InferenceLiang Zhang, Jinsong Su, Yidong Chen, Zhongjian Miao et al.EMNLP 2022 · 11 citations
- Chapter Ordering in NovelsAllen Kim, Steven SkienaEMNLP 2022 · 1 citation
Builds on7
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Deep Attentive Ranking Networks for Learning to Order SentencesPawan Kumar, Dhanajit Brahma, Harish Karnick, Piyush RaiAAAI 2020 · 52 citations
- Structural Information Preserving for Graph-to-Text GenerationLinfeng Song, Ante Wang, Jinsong Su, Yue Zhang et al.ACL 2020 · 45 citations
- Enhancing Pointer Network for Sentence Ordering with Pairwise Ordering PredictionsYongjing Yin, Fandong Meng, Jinsong Su, Yubin Ge et al.AAAI 2020 · 32 citations
- BERT-enhanced Relational Sentence Ordering NetworkBaiyun Cui, Yingming Li, Zhongfei ZhangEMNLP 2020 · 32 citations
Related papers
- Neural Sentence Ordering Based on Constraint GraphsYutao Zhu, Kun Zhou, Jian-Yun Nie, Shengchao Liu et al.AAAI 2021 · 24 citations
- STaCK: Sentence Ordering with Temporal Commonsense KnowledgeDeepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya PoriaEMNLP 2021 · 5 citations
- Graph-Based Transformer with Cross-Candidate Verification for Semantic ParsingBo Shao, Yeyun Gong, Weizhen Qi, Guihong Cao et al.AAAI 2020 · 9 citations
- Neural Extractive Summarization with Hierarchical Attentive Heterogeneous Graph NetworkRuipeng Jia, Yanan Cao, Hengzhu Tang, Fang Fang et al.EMNLP 2020 · 87 citations
- Global Greedy Dependency ParsingZuchao Li, Hai Zhao, Kevin ParnowAAAI 2020 · 34 citations
