Lune

ACL Findings2023

OASum: Large-Scale Open Domain Aspect-based Summarization

Xianjun Yang, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Xiaoman Pan, Linda R. Petzold, Dong Yu

Abstract

Aspect or query-based summarization has recently caught more attention, as it can generate differentiated summaries based on users' interests. However, the current dataset for aspect or query-based summarization either focuses on specific domains, contains relatively small-scale instances, or includes only a few aspect types. Such limitations hinder further explorations in this direction. In this work, we take advantage of crowd-sourcing knowledge on Wikipedia.org and automatically create a high-quality, large-scale open-domain aspectbased summarization dataset named OASum, which contains more than 3.7 million instances with around 1 million different aspects on 2 million Wikipedia pages. We provide benchmark results on OASum and demonstrate its ability for diverse aspect-based summarization generation. To overcome the data scarcity problem on specific domains, we also perform zero-shot, few-shot, and fine-tuning on seven downstream datasets. Specifically, zero/few-shot and finetuning results show that the model pre-trained on our corpus demonstrates a strong aspect or query-focused generation ability compared with the backbone model. Our dataset and pretrained checkpoints are publicly available. 1

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Big Bird: Transformers for Longer Sequences cites On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
  • Big Bird: Transformers for Longer Sequences cites PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
  • On Extractive and Abstractive Neural Document Summarization with Transformer Language Models cites PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
  • PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization cites On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
  • BRIO: Bringing Order to Abstractive Summarization cites Extractive Summarization as Text Matching
  • BRIO: Bringing Order to Abstractive Summarization cites PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. OpenAsp: A Benchmark for Multi-document Open Aspect-based SummarizationShmuel Amar, Liat Schiff, Ori Ernst, Asi Shefer et al.EMNLP 2023 · 3 citations
  2. ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language ModelsBenjamin Newman, Yoonjoo Lee, Aakanksha Naik, Pao Siangliulue et al.EMNLP 2024 · 1 citation
  3. TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical DomainBohao Chu, Meijie Li, Sameh Frihat, Chengyu Gu et al.EMNLP 2025

Builds on14

  1. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
  2. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. LiuICML 2020 · 2,453 citations
  3. Extractive Summarization as Text MatchingMing Zhong, Pengfei Liu, Yiran Chen, Danqing Wang et al.ACL 2020 · 410 citations
  4. BRIO: Bringing Order to Abstractive SummarizationYixin Liu, Pengfei Liu, Dragomir R. Radev, Graham NeubigACL 2022 · 329 citations
  5. On Extractive and Abstractive Neural Document Summarization with Transformer Language ModelsJonathan Pilault, Raymond Li, Sandeep Subramanian, Chris PalEMNLP 2020 · 186 citations

Related papers

  1. QuerySum: A Multi-Document Query-Focused Summarization Dataset Augmented with Similar Query ClustersYushan Liu, Zili Wang, Ruifeng YuanAAAI 2024 · 14 citations
  2. ASPECTNEWS: Aspect-Oriented Summarization of News DocumentsOjas Ahuja, Jiacheng Xu, Akshay Gupta, Kevin Horecka et al.ACL 2022
  3. Aspect-Controllable Opinion SummarizationReinald Kim Amplayo, Stefanos Angelidis, Mirella LapataEMNLP 2021
  4. ForumSum: A Multi-Speaker Conversation Summarization DatasetMisha Khalman, Yao Zhao, Mohammad SalehEMNLP Findings 2021 · 11 citations
  5. LMGQS: A Large-scale Dataset for Query-focused SummarizationRuochen Xu, Song Wang, Yang Liu, Shuohang Wang et al.EMNLP Findings 2023
Dusk over the sea between two cliffs drawn in fine vertical lines