Low-Resource Knowledge-Grounded Dialogue Generation
Xueliang Zhao, Wei Wu, Chongyang Tao, Can Xu, Dongyan Zhao, Rui Yan
Abstract
Responding with knowledge has been recognized as an important capability for an intelligent conversational agent. Yet knowledge-grounded dialogues, as training data for learning such a response generation model, are difficult to obtain. Motivated by the challenge in practice, we consider knowledge-grounded dialogue generation under a natural assumption that only limited training examples are available. In such a low-resource setting, we devise a disentangled response decoder in order to isolate parameters that depend on knowledge-grounded dialogues from the entire generation model. By this means, the major part of the model can be learned from a large number of ungrounded dialogues and unstructured documents, while the remaining small parameters can be well fitted using the limited training examples. Evaluation results on two benchmarks indicate that with only training data, our model can achieve the state-of-the-art performance and generalize well on out-of-domain knowledge.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9ade8717-8e28-4161-9735-9af0be9ba883Cited by top-tier papers19
- Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsXueliang Zhao, Wei Wu, Can Xu, Chongyang Tao et al.EMNLP 2020 · 153 citations
- Zero-Resource Knowledge-Grounded Dialogue GenerationLinxiao Li, Can Xu, Wei Wu, Yufan Zhao et al.NeurIPS 2020 · 75 citations
- Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue GenerationShuai Lin, Pan Zhou, Xiaodan Liang, Jianheng Tang et al.AAAI 2021 · 66 citations
- Initiative-Aware Self-Supervised Learning for Knowledge-Grounded ConversationsChuan Meng, Pengjie Ren, Zhumin Chen, Zhaochun Ren et al.SIGIR 2021 · 34 citations
- Learning to Copy Coherent Knowledge for Response GenerationJiaqi Bai, Ze Yang, Xinnian Liang, Wei Wang et al.AAAI 2021 · 28 citations
Related papers
- A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue GenerationShilei Liu, Xiaofeng Zhao, Bochao Li, Feiliang Ren et al.EMNLP 2021 · 24 citations
- KPT: Keyword-Guided Pre-training for Grounded Dialog GenerationQi Zhu, Fei Mi, Zheng Zhang, Yasheng Wang et al.AAAI 2023 · 5 citations
- Multimodal Dialogue Response GenerationQingfeng Sun, Yujing Wang, Can Xu, Kai Zheng et al.ACL 2022 · 58 citations
- A Synthetic Data Generation Framework for Grounded DialoguesJianzhu Bao, Rui Wang, Yasheng Wang, Aixin Sun et al.ACL 2023 · 11 citations
- A Pre-training Strategy for Zero-Resource Response Selection in Knowledge-Grounded ConversationsChongyang Tao, Changyu Chen, Jiazhan Feng, Ji-Rong Wen et al.ACL 2021
