Lune

EMNLP Findings2022

Unsupervised Multi-Granularity Summarization

Ming Zhong, Yang Liu, Suyu Ge, Yuning Mao, Yizhu Jiao, Xingxing Zhang, Yichong Xu, Chenguang Zhu, Michael Zeng, Jiawei Han

Abstract

Text summarization is a user-preference based task, i.e., for one document, users often have different priorities for summary. As a key aspect of customization in summarization, granularity is used to measure the semantic coverage between summary and source document. However, developing systems that can generate summaries with customizable semantic coverage is still an under-explored topic. In this paper, we propose the first unsupervised multi-granularity summarization framework, GRANUSUM. We take events as the basic semantic units of the source documents and propose to rank these events by their salience. We also develop a model to summarize input documents with given events as anchors and hints. By inputting different numbers of events, GRANUSUM is capable of producing multi-granular summaries in an unsupervised manner. Meanwhile, we annotate a new benchmark GranuDUC that contains multiple summaries at different granularities for each document cluster. Experimental results confirm the substantial superiority of GRANUSUM on multi-granularity summarization over strong baselines. Furthermore, by exploiting the event information, GRANUSUM also exhibits state-of-the-art performance under conventional unsupervised abstractive setting. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 3 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers3

  1. An AI-Resilient Text Rendering Technique for Reading and Skimming DocumentsZiwei Gu, Ian Arawjo, Kenneth Li, Jonathan K. Kummerfeld et al.CHI 2024 · 31 citations
  2. Desirable Unfamiliarity: Insights from Eye Movements on Engagement and Readability of Dictation InterfacesZhaohui Liang, Yonglin Chen, Naser Al Madi, Can LiuCHI 2026 · 1 citation
  3. Evaluating Taxonomy Free Character Role Labeling (TF-CRL) in News Stories using Large Language ModelsDavid G. Hobson, Derek Ruths, Andrew PiperEMNLP 2025

Builds on13

  1. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  2. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. LiuICML 2020 · 2,453 citations
  3. BARTScore: Evaluating Generated Text as Text GenerationWeizhe Yuan, Graham Neubig, Pengfei LiuNeurIPS 2021 · 1,143 citations
  4. Extractive Summarization as Text MatchingMing Zhong, Pengfei Liu, Yiran Chen, Danqing Wang et al.ACL 2020 · 410 citations
  5. BRIO: Bringing Order to Abstractive SummarizationYixin Liu, Pengfei Liu, Dragomir R. Radev, Graham NeubigACL 2022 · 329 citations

Related papers

  1. Multi-Granularity Interaction Network for Extractive and Abstractive Multi-Document SummarizationHanqi Jin, Tianming Wang, Xiaojun WanACL 2020 · 92 citations
  2. Scientific Paper Extractive Summarization Enhanced by Citation GraphsXiuying Chen, Mingzhe Li, Shen Gao, Rui Yan et al.EMNLP 2022 · 8 citations
  3. Topic-Guided Abstractive Multi-Document SummarizationPeng Cui, Le HuEMNLP Findings 2021 · 38 citations
  4. Document Summarization with VHTM: Variational Hierarchical Topic-Aware MechanismXiyan Fu, Jun Wang, Jinghan Zhang, Jinmao Wei et al.AAAI 2020 · 28 citations
  5. The Summary Loop: Learning to Write Abstractive Summaries Without ExamplesPhilippe Laban, Andrew Hsi, John F. Canny, Marti A. HearstACL 2020 · 26 citations
Dusk over the sea between two cliffs drawn in fine vertical lines