Instructive Dialogue Summarization with Query Aggregations
Bin Wang, Zhengyuan Liu, Nancy F. Chen
Abstract
Conventional dialogue summarization methods directly generate summaries and do not consider user's specific interests. This poses challenges in cases where the users are more focused on particular topics or aspects. With the advancement of instruction-finetuned language models, we introduce instruction-tuning to dialogues to expand the capability set of dialogue summarization models. To overcome the scarcity of instructive dialogue summarization data, we propose a three-step approach to synthesize high-quality query-based summarization triples. This process involves summaryanchored query generation, query filtering and query-based summary generation. By training a unified model called InstructDS (Instructive Dialogue Summarization) on three summarization datasets with multi-purpose instructive triples, we expand the capability of dialogue summarization models. We evaluate our method on four datasets, including dialogue summarization and dialogue reading comprehension. Experimental results show that our approach outperforms the state-of-the-art models and even models with larger sizes. Additionally, our model exhibits higher generalizability and faithfulness, as confirmed by human subjective evaluations 1 . 1 https://github.com/BinWang28/InstructDS Benjamin: Hey guys, what are we doing with the keys today? Hilary: I've got them. Whoever wants them can meet me at lunchtime or after Elliot: I'm ok. We're meeting for the drinks in the evening anyway and … Benjamin: Interesting To be honest, Hilary, I almost feel like changing my mind. Wanting to take this nap might end up costing me to dear … Hilary: Do join us, we're going to have fun. And then you'll take the keys and take this most deserved of naps Elliot: Sounds like a plan
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cae7de8a-8c99-46fc-8c8d-345f36059d62Cited by top-tier papers3
- CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text GenerationHan He, Qianchu Liu, Lei Xu, Chaitanya Shivade et al.AAAI 2025 · 13 citations
- Adaptive Planning for Multi-Attribute Controllable Summarization with Monte Carlo Tree SearchSangwon Ryu, Heejin Do, Yunsu Kim, Gary Geunbae Lee et al.ACL 2026 · 2 citations
- Domain Adaptation for Subjective Induction Questions Answering on Products by Adversarial Disentangled LearningYufeng Zhang, Jianxing Yu, Yanghui Rao, Libin Zheng et al.ACL 2024
Builds on13
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
Related papers
- Curriculum Prompt Learning with Self-Training for Abstractive Dialogue SummarizationChangqun Li, Linlin Wang, Xin Lin, Gerard de Melo et al.EMNLP 2022 · 8 citations
- InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction TuningPrakhar Gupta, Cathy Jiao, Yi-Ting Yeh, Shikib Mehri et al.EMNLP 2022 · 26 citations
- DIONYSUS: A Pre-trained Model for Low-Resource Dialogue SummarizationYu Li, Baolin Peng, Pengcheng He, Michel Galley et al.ACL 2023 · 4 citations
- ADPL: Adversarial Prompt-based Domain Adaptation for Dialogue Summarization with Knowledge DisentanglementLulu Zhao, Fujia Zheng, Weihao Zeng, Keqing He et al.SIGIR 2022 · 6 citations
- Dialogue Summarization with Static-Dynamic Structure Fusion GraphShen Gao, Xin Cheng, Mingzhe Li, Xiuying Chen et al.ACL 2023 · 14 citations
