Neural Sentence Ordering Based on Constraint Graphs
Yutao Zhu, Kun Zhou, Jian-Yun Nie, Shengchao Liu, Zhicheng Dou
Abstract
Sentence ordering aims at arranging a list of sentences in the correct order. Based on the observation that sentence order at different distances may rely on different types of information, we devise a new approach based on multi-granular orders between sentences. These orders form multiple constraint graphs, which are then encoded by Graph Isomorphism Networks and fused into sentence representations. Finally, sentence order is determined using the order-enhanced sentence representations. Our experiments on five benchmark datasets show that our method outperforms all the existing baselines significantly, achieving a new state-of-the-art performance. The results demonstrate the advantage of considering multiple types of order information and using graph neural networks to integrate sentence content and order information for the task. Our code is available at https://github.com/ DaoD/ConstraintGraph4NSO .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 287bda2c-8333-4c01-bad0-e2aa9f2c8466Cited by top-tier papers7
- Modeling Intent Graph for Search Result DiversificationZhan Su, Zhicheng Dou, Yutao Zhu, Xubo Qin et al.SIGIR 2021 · 32 citations
- Webformer: Pre-training with Web Pages for Information RetrievalYu Guo, Zhengyi Ma, Jiaxin Mao, Hongjin Qian et al.SIGIR 2022 · 30 citations
- STaCK: Sentence Ordering with Temporal Commonsense KnowledgeDeepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya PoriaEMNLP 2021 · 5 citations
- Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise OrderingsShaopeng Lai, Ante Wang, Fandong Meng, Jie Zhou et al.EMNLP 2021 · 5 citations
- Leveraging Weak Cross-Modal Guidance for Coherence Modelling via Iterative LearningYi Bin, Junrong Liao, Yujuan Ding, Haoxuan Li et al.ACM MM 2024 · 3 citations
Builds on4
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Deep Attentive Ranking Networks for Learning to Order SentencesPawan Kumar, Dhanajit Brahma, Harish Karnick, Piyush RaiAAAI 2020 · 52 citations
- Enhancing Pointer Network for Sentence Ordering with Pairwise Ordering PredictionsYongjing Yin, Fandong Meng, Jinsong Su, Yubin Ge et al.AAAI 2020 · 32 citations
- ScriptWriter: Narrative-Guided Script GenerationYutao Zhu, Ruihua Song, Zhicheng Dou, Jian-Yun Nie et al.ACL 2020 · 23 citations
Related papers
- SLM: Learning a Discourse Language Representation with Sentence UnshufflingHaejun Lee, Drew A. Hudson, Kangwook Lee, Christopher D. ManningEMNLP 2020 · 2 citations
- RECON: Relation Extraction using Knowledge Graph Context in a Graph Neural NetworkAnson Bastos, Abhishek Nadgeri, Kuldeep Singh, Isaiah Onando Mulang' et al.WWW 2021 · 92 citations
- HEGEL: Hypergraph Transformer for Long Document SummarizationHaopeng Zhang, Xiao Liu, Jiawei ZhangEMNLP 2022 · 33 citations
- Span Graph Transformer for Document-Level Named Entity RecognitionHongli Mao, Xian-Ling Mao, Hanlin Tang, Yuming Shang et al.AAAI 2024 · 3 citations
- Structure-aware Knowledge Graph-to-text Generation with Planning Selection and Similarity DistinctionFeng Zhao, Hongzhi Zou, Cheng YanEMNLP 2023 · 5 citations
