ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining
Alexander R. Fabbri, Faiaz Rahman, Imad Rizvi, Borui Wang, Haoran Li, Yashar Mehdad, Dragomir R. Radev
Abstract
While online conversations can cover a vast amount of information in many different formats, abstractive text summarization has primarily focused on modeling solely news articles. This research gap is due, in part, to the lack of standardized datasets for summarizing online discussions. To address this gap, we design annotation protocols motivated by an issues-viewpoints-assertions framework to crowdsource four new datasets on diverse online conversation forms of news comments, discussion forums, community question answering forums, and email threads. We benchmark state-of-the-art models on our datasets and analyze characteristics associated with the data. To create a comprehensive benchmark, we also evaluate these models on widely-used conversation summarization datasets to establish strong baselines in this domain. Furthermore, we incorporate argument mining through graph construction to directly model the issues, viewpoints, and assertions present in a conversation and filter noisy input, showing comparable or improved results according to automatic and human evaluations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7f86bdcf-b50d-474d-b5e9-00c94812a92dCited by top-tier papers13
- DialogLM: Pre-trained Model for Long Dialogue Understanding and SummarizationMing Zhong, Yang Liu, Yichong Xu, Chenguang Zhu et al.AAAI 2022 · 150 citations
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error DetectorsLiyan Tang, Tanya Goyal, Alexander R. Fabbri, Philippe Laban et al.ACL 2023 · 38 citations
- A Generative Model for End-to-End Argument Mining with Reconstructed Positional Encoding and Constrained Pointer MechanismJianzhu Bao, Yuhang He, Yang Sun, Bin Liang et al.EMNLP 2022 · 15 citations
- Curriculum Prompt Learning with Self-Training for Abstractive Dialogue SummarizationChangqun Li, Linlin Wang, Xin Lin, Gerard de Melo et al.EMNLP 2022 · 8 citations
- ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue SummarizationXiutian Zhao, Ke Wang, Wei PengEMNLP 2023 · 5 citations
Builds on8
- PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. LiuICML 2020 · 2,453 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue SummarizationJiaao Chen, Diyi YangEMNLP 2020 · 121 citations
- Generating Representative Headlines for News StoriesXiaotao Gu, Yuning Mao, Jiawei Han, Jialu Liu et al.WWW 2020 · 77 citations
- Joint Learning of Answer Selection and Answer Summary Generation in Community Question AnsweringYang Deng, Wai Lam, Yuexiang Xie, Daoyuan Chen et al.AAAI 2020 · 65 citations
Related papers
- EmailSum: Abstractive Email Thread SummarizationShiyue Zhang, Asli Celikyilmaz, Jianfeng Gao, Mohit BansalACL 2021
- CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue SummarizationHaitao Lin, Liqun Ma, Junnan Zhu, Lu Xiang et al.EMNLP 2021 · 21 citations
- ARQUSUMM: Argument-aware Quantitative Summarization of Online ConversationsAn Quang Tang, Xiuzhen Zhang, Minh Ngoc Dinh, Zhuang LiAAAI 2026
- ArgCMV: An Argument Summarization Benchmark for the LLM-eraOmkar Gurjar, Agam Goyal, Eshwar ChandrasekharanEMNLP 2025
- SumREN: Summarizing Reported Speech about Events in NewsRevanth Gangi Reddy, Heba Elfardy, Hou Pong Chan, Kevin Small et al.AAAI 2023 · 7 citations
