ACL Findings2023
OASum: Large-Scale Open Domain Aspect-based Summarization
Xianjun Yang, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Xiaoman Pan, Linda R. Petzold, Dong Yu
Abstract
Aspect or query-based summarization has recently caught more attention, as it can generate differentiated summaries based on users' interests. However, the current dataset for aspect or query-based summarization either focuses on specific domains, contains relatively small-scale instances, or includes only a few aspect types. Such limitations hinder further explorations in this direction. In this work, we take advantage of crowd-sourcing knowledge on Wikipedia.org and automatically create a high-quality, large-scale open-domain aspectbased summarization dataset named OASum, which contains more than 3.7 million instances with around 1 million different aspects on 2 million Wikipedia pages. We provide benchmark results on OASum and demonstrate its ability for diverse aspect-based summarization generation. To overcome the data scarcity problem on specific domains, we also perform zero-shot, few-shot, and fine-tuning on seven downstream datasets. Specifically, zero/few-shot and finetuning results show that the model pre-trained on our corpus demonstrates a strong aspect or query-focused generation ability compared with the backbone model. Our dataset and pretrained checkpoints are publicly available. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
3 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Big Bird: Transformers for Longer Sequences cites On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
- Big Bird: Transformers for Longer Sequences cites PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
- On Extractive and Abstractive Neural Document Summarization with Transformer Language Models cites PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
- PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization cites On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
- BRIO: Bringing Order to Abstractive Summarization cites Extractive Summarization as Text Matching
- BRIO: Bringing Order to Abstractive Summarization cites PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Cited by top-tier papers3
- OpenAsp: A Benchmark for Multi-document Open Aspect-based SummarizationShmuel Amar, Liat Schiff, Ori Ernst, Asi Shefer et al.EMNLP 2023 · 3 citations
- ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language ModelsBenjamin Newman, Yoonjoo Lee, Aakanksha Naik, Pao Siangliulue et al.EMNLP 2024 · 1 citation
- TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical DomainBohao Chu, Meijie Li, Sameh Frihat, Chengyu Gu et al.EMNLP 2025
Builds on14
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
- PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. LiuICML 2020 · 2,453 citations
- Extractive Summarization as Text MatchingMing Zhong, Pengfei Liu, Yiran Chen, Danqing Wang et al.ACL 2020 · 410 citations
- BRIO: Bringing Order to Abstractive SummarizationYixin Liu, Pengfei Liu, Dragomir R. Radev, Graham NeubigACL 2022 · 329 citations
- On Extractive and Abstractive Neural Document Summarization with Transformer Language ModelsJonathan Pilault, Raymond Li, Sandeep Subramanian, Chris PalEMNLP 2020 · 186 citations
Related papers
- QuerySum: A Multi-Document Query-Focused Summarization Dataset Augmented with Similar Query ClustersYushan Liu, Zili Wang, Ruifeng YuanAAAI 2024 · 14 citations
- ASPECTNEWS: Aspect-Oriented Summarization of News DocumentsOjas Ahuja, Jiacheng Xu, Akshay Gupta, Kevin Horecka et al.ACL 2022
- Aspect-Controllable Opinion SummarizationReinald Kim Amplayo, Stefanos Angelidis, Mirella LapataEMNLP 2021
- ForumSum: A Multi-Speaker Conversation Summarization DatasetMisha Khalman, Yao Zhao, Mohammad SalehEMNLP Findings 2021 · 11 citations
- LMGQS: A Large-scale Dataset for Query-focused SummarizationRuochen Xu, Song Wang, Yang Liu, Shuohang Wang et al.EMNLP Findings 2023
