EMNLP Findings2021
ForumSum: A Multi-Speaker Conversation Summarization Dataset
Misha Khalman, Yao Zhao, Mohammad Saleh
Abstract
Abstractive summarization quality had large improvements since recent language pretraining techniques. However, currently there is a lack of datasets for the growing needs of conversation summarization applications. Thus we collected ForumSum 1 , a diverse and highquality conversation summarization dataset with human written summaries. The conversations in ForumSum dataset are collected from a wide variety of internet forums. To make the dataset easily expandable, we also release the process of dataset creation. Our experiments show that models trained on ForumSum have better zero-shot and few-shot transferability to other datasets than the existing large chat summarization dataset SAMSum. We also show that using a conversational corpus for pre-training improves the quality of the chat summarization model.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 5 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers5
- MeetingBank: A Benchmark Dataset for Meeting SummarizationYebowen Hu, Timothy Ganter, Hanieh Deilamsalehy, Franck Dernoncourt et al.ACL 2023 · 19 citations
- Out-of-Distribution Detection and Selective Generation for Conditional Language ModelsJie Ren, Jiaming Luo, Yao Zhao, Kundan Krishna et al.ICLR 2023 · 12 citations
- ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue SummarizationXiutian Zhao, Ke Wang, Wei PengEMNLP 2023 · 5 citations
- Summarizing Community-based Question-Answer PairsTing-Yao Hsu, Yoshi Suhara, Xiaolan WangEMNLP 2022 · 5 citations
- AdAEM: An Adaptively and Automated Extensible Measurement of LLMs' Value DifferenceJing Yao, Shitong Duan, Xiaoyuan Yi, Dongkuan Xu et al.ICLR 2026 · 4 citations
Builds on3
- PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. LiuICML 2020 · 2,453 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- SummScreen: A Dataset for Abstractive Screenplay SummarizationMingda Chen, Zewei Chu, Sam Wiseman, Kevin GimpelACL 2022
Related papers
- Summary Grounded Conversation GenerationR. Chulaka Gunasekara, Guy Feigenblat, Benjamin Sznajder, Sachindra Joshi et al.ACL Findings 2021 · 5 citations
- Simple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue SummarizationJiaao Chen, Diyi YangEMNLP 2021 · 31 citations
- Multi-Stage Pre-training Enhanced by ChatGPT for Multi-Scenario Multi-Domain Dialogue SummarizationWeixiao Zhou, Gengyao Li, Xianfu Cheng, Xinnian Liang et al.EMNLP Findings 2023 · 1 citation
- ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument MiningAlexander R. Fabbri, Faiaz Rahman, Imad Rizvi, Borui Wang et al.ACL 2021
- XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 LanguagesTahmid Hasan, Abhik Bhattacharjee, Md. Saiful Islam, Kazi Samin Mubasshir et al.ACL Findings 2021 · 228 citations
