Lune

EMNLP Findings2023

Exploring the Effectiveness of Multi-Lingual Commonsense Knowledge-Aware Open-Domain Dialogue Response Generation

Sixing Wu, Jiong Yu, Tianshi Che, Yang Zhou, Wei Zhou

Abstract

Prior works have shown the promising results of commonsense knowledge-aware models in improving informativeness while reducing the hallucination issue. Nonetheless, prior works often can only use monolingual knowledge whose language is consistent with the dialogue context. Except for a few high-resource languages, such as English and Chinese, most languages suffer from insufficient knowledge issues, especially minority languages. To this end, this work proposes a new task, Multi-Lingual Commonsense Knowledge-Aware Response Generation (MCKRG), which tries to use commonsense knowledge in other languages to enhance the current dialogue generation. Then, we construct a MCKRG dataset MCK-Dialog 1 of seven languages with multiple alignment methods. Finally, we verify the effectiveness of using multi-lingual commonsense knowledge with a proposed MCK-T5 model. Extensive experimental results demonstrate the great potential of using multi-lingual commonsense knowledge in high-resource and lowresource languages. To the best of our knowledge, this work is the first to explore Multi-Lingual Commonsense Knowledge-Aware Response Generation .

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on14

  1. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
  2. Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge GraphsHouyu Zhang, Zhenghao Liu, Chenyan Xiong, Zhiyuan LiuACL 2020 · 125 citations
  3. Low-Resource Knowledge-Grounded Dialogue GenerationXueliang Zhao, Wei Wu, Chongyang Tao, Can Xu et al.ICLR 2020 · 115 citations
  4. Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge AwarenessSixing Wu, Ying Li, Dawei Zhang, Yang Zhou et al.ACL 2020 · 104 citations
  5. Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt CompletionKurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller et al.EMNLP Findings 2022 · 72 citations

Related papers

  1. Improving Open-Domain Dialogue Response Generation with Multi-Source Multilingual Commonsense KnowledgeSixing Wu, Jiong Yu, Jiahao Chen, Xiaofan Deng et al.AAAI 2024 · 5 citations
  2. A Model of Cross-Lingual Knowledge-Grounded Response Generation for Open-Domain Dialogue SystemsSan Kim, Jin Yea Jang, Minyoung Jung, Saim ShinEMNLP Findings 2021 · 15 citations
  3. Improving Knowledge-Aware Dialogue Generation via Knowledge Base Question AnsweringJian Wang, Junhao Liu, Wei Bi, Xiaojiang Liu et al.AAAI 2020 · 52 citations
  4. CN-AutoMIC: Distilling Chinese Commonsense Knowledge from Pretrained Language ModelsChenhao Wang, Jiachun Li, Yubo Chen, Kang Liu et al.EMNLP 2022 · 2 citations
  5. Multiple Knowledge Syncretic Transformer for Natural Dialogue GenerationXiangyu Zhao, Longbiao Wang, Ruifang He, Ting Yang et al.WWW 2020 · 27 citations
Dusk over the sea between two cliffs drawn in fine vertical lines