EMNLP Findings2023
Exploring the Effectiveness of Multi-Lingual Commonsense Knowledge-Aware Open-Domain Dialogue Response Generation
Sixing Wu, Jiong Yu, Tianshi Che, Yang Zhou, Wei Zhou
Abstract
Prior works have shown the promising results of commonsense knowledge-aware models in improving informativeness while reducing the hallucination issue. Nonetheless, prior works often can only use monolingual knowledge whose language is consistent with the dialogue context. Except for a few high-resource languages, such as English and Chinese, most languages suffer from insufficient knowledge issues, especially minority languages. To this end, this work proposes a new task, Multi-Lingual Commonsense Knowledge-Aware Response Generation (MCKRG), which tries to use commonsense knowledge in other languages to enhance the current dialogue generation. Then, we construct a MCKRG dataset MCK-Dialog 1 of seven languages with multiple alignment methods. Finally, we verify the effectiveness of using multi-lingual commonsense knowledge with a proposed MCK-T5 model. Extensive experimental results demonstrate the great potential of using multi-lingual commonsense knowledge in high-resource and lowresource languages. To the best of our knowledge, this work is the first to explore Multi-Lingual Commonsense Knowledge-Aware Response Generation .
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on14
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge GraphsHouyu Zhang, Zhenghao Liu, Chenyan Xiong, Zhiyuan LiuACL 2020 · 125 citations
- Low-Resource Knowledge-Grounded Dialogue GenerationXueliang Zhao, Wei Wu, Chongyang Tao, Can Xu et al.ICLR 2020 · 115 citations
- Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge AwarenessSixing Wu, Ying Li, Dawei Zhang, Yang Zhou et al.ACL 2020 · 104 citations
- Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt CompletionKurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller et al.EMNLP Findings 2022 · 72 citations
Related papers
- Improving Open-Domain Dialogue Response Generation with Multi-Source Multilingual Commonsense KnowledgeSixing Wu, Jiong Yu, Jiahao Chen, Xiaofan Deng et al.AAAI 2024 · 5 citations
- A Model of Cross-Lingual Knowledge-Grounded Response Generation for Open-Domain Dialogue SystemsSan Kim, Jin Yea Jang, Minyoung Jung, Saim ShinEMNLP Findings 2021 · 15 citations
- Improving Knowledge-Aware Dialogue Generation via Knowledge Base Question AnsweringJian Wang, Junhao Liu, Wei Bi, Xiaojiang Liu et al.AAAI 2020 · 52 citations
- CN-AutoMIC: Distilling Chinese Commonsense Knowledge from Pretrained Language ModelsChenhao Wang, Jiachun Li, Yubo Chen, Kang Liu et al.EMNLP 2022 · 2 citations
- Multiple Knowledge Syncretic Transformer for Natural Dialogue GenerationXiangyu Zhao, Longbiao Wang, Ruifang He, Ting Yang et al.WWW 2020 · 27 citations
