Lune

ACL Findings2021

Improving Unsupervised Extractive Summarization with Facet-Aware Modeling

Xinnian Liang, Shuangzhi Wu, Mu Li, Zhoujun Li

Abstract

Unsupervised extractive summarization aims to extract salient sentences from documents without labeled corpus. Existing methods are mostly graph-based by computing sentence centrality. These methods usually tend to select sentences within the same facet, however, which often leads to the facet bias problem especially when the document has multiple facets (i.e. long-document and multidocuments). To address this problem, we proposed a novel facet-aware centrality-based ranking model. We let the model pay more attention to different facets by introducing a sentence-document weight. The weight is added to the sentence centrality score. We evaluate our method on a wide range of summarization tasks that include 8 representative benchmark datasets. Experimental results show that our method consistently outperforms strong baselines especially in longand multi-document scenarios and even performs comparably to some supervised models. Extensive analyses confirm that the performance gains come from alleviating the facet bias problem.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 4 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers4

  1. Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global ContextXinnian Liang, Shuangzhi Wu, Mu Li, Zhoujun LiEMNLP 2021 · 49 citations
  2. Unsupervised Extractive Summarization with Learnable Length Control StrategiesRenlong Jie, Xiaojun Meng, Xin Jiang, Qun LiuAAAI 2024 · 8 citations
  3. MultiSum: A Multi-Facet Approach for Extractive Social Summarization Utilizing Semantic and Sociological RelationshipsTanglong Zhao, Ruifang He, Jing Xu, Bo WangAAAI 2024 · 2 citations
  4. GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly ReviewsMaxime Darrin, Ines Arous, Pablo Piantanida, Jackie Chi Kit CheungACL 2024 · 1 citation

Builds on7

  1. Extractive Summarization as Text MatchingMing Zhong, Pengfei Liu, Yiran Chen, Danqing Wang et al.ACL 2020 · 410 citations
  2. Heterogeneous Graph Neural Networks for Extractive Document SummarizationDanqing Wang, Pengfei Liu, Yining Zheng, Xipeng Qiu et al.ACL 2020 · 275 citations
  3. Multi-Granularity Interaction Network for Extractive and Abstractive Multi-Document SummarizationHanqi Jin, Tianming Wang, Xiaojun WanACL 2020 · 92 citations
  4. SemSUM: Semantic Dependency Guided Neural Abstractive SummarizationHanqi Jin, Tianming Wang, Xiaojun WanAAAI 2020 · 60 citations
  5. Jointly Learning to Align and Summarize for Neural Cross-Lingual SummarizationYue Cao, Hui Liu, Xiaojun WanACL 2020 · 52 citations

Related papers

  1. Unsupervised Extractive Summarization by Pre-training Hierarchical TransformersShusheng Xu, Xingxing Zhang, Yi Wu, Furu Wei et al.EMNLP Findings 2020 · 41 citations
  2. Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-EncodersQianren Mao, Shaobo Zhao, Jiarui Li, Xiaolei Gu et al.EMNLP Findings 2023 · 4 citations
  3. Discourse-Aware Neural Extractive Text SummarizationJiacheng Xu, Zhe Gan, Yu Cheng, Jingjing LiuACL 2020 · 264 citations
  4. Extending Multi-Sense Word Embedding to Phrases and Sentences for Unsupervised Semantic ApplicationsHaw-Shiuan Chang, Amol Agrawal, Andrew McCallumAAAI 2021 · 9 citations
  5. Scientific Paper Extractive Summarization Enhanced by Citation GraphsXiuying Chen, Mingzhe Li, Shen Gao, Rui Yan et al.EMNLP 2022 · 8 citations
Dusk over the sea between two cliffs drawn in fine vertical lines