Conversations Powered by Cross-Lingual Knowledge
Weiwei Sun, Chuan Meng, Qi Meng, Zhaochun Ren, Pengjie Ren, Zhumin Chen, Maarten de Rijke
Abstract
Today's open-domain conversational agents increase the informativeness of generated responses by leveraging external knowledge. Most of the existing approaches work only for scenarios with a massive amount of monolingual knowledge sources. For languages with limited availability of knowledge sources, it is not effective to use knowledge in the same language to generate informative responses. To address this problem, we propose the task of cross-lingual knowledge grounded conversation (CKGC), where we leverage large-scale knowledge sources in another language to generate informative responses. Two main challenges come with the task of cross-lingual knowledge grounded conversation: (1) knowledge selection and response generation in a cross-lingual setting; and (2) the lack of a test dataset for evaluation. To tackle the first challenge, we propose the curriculum self-knowledge distillation (CSKD) scheme, which utilizes a large-scale dialogue corpus in an auxiliary language to improve cross-lingual knowledge selection and knowledge expression in the target language via knowledge distillation. To tackle the second challenge, we collect a cross-lingual knowledge grounded conversation test dataset to facilitate relevant research in the future. Extensive experiments on the newly created dataset verify the effectiveness of our proposed curriculum self-knowledge distillation method for cross-lingual knowledge grounded conversation. In addition, we find that our proposed unsupervised method significantly outperforms the state-of-the-art baselines in cross-lingual knowledge selection.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Initiative-Aware Self-Supervised Learning for Knowledge-Grounded ConversationsChuan Meng, Pengjie Ren, Zhumin Chen, Zhaochun Ren et al.SIGIR 2021 · 34 citations
- Answering Ambiguous Questions via Iterative PromptingWeiwei Sun, Hengyi Cai, Hongshen Chen, Pengjie Ren et al.ACL 2023 · 3 citations
- Curriculum Knowledge Distillation for Emoji-supervised Cross-lingual Sentiment AnalysisJianyang Zhang, Tao Liang, Mingyang Wan, Guowu Yang et al.EMNLP 2022 · 2 citations
- Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent BiasesRena Wei Gao, Xuetong Wu, Tatsuki Kuribayashi, Mingrui Ye et al.ACL 2025
Builds on11
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
- Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsXueliang Zhao, Wei Wu, Can Xu, Chongyang Tao et al.EMNLP 2020 · 153 citations
- Cross-Lingual Natural Language Generation via Pre-TrainingZewen Chi, Li Dong, Furu Wei, Wenhui Wang et al.AAAI 2020 · 142 citations
- Distilling Knowledge Learned in BERT for Text GenerationYen-Chun Chen, Zhe Gan, Yu Cheng, Jingzhou Liu et al.ACL 2020 · 116 citations
- Zero-Resource Knowledge-Grounded Dialogue GenerationLinxiao Li, Can Xu, Wei Wu, Yufan Zhao et al.NeurIPS 2020 · 75 citations
Related papers
- KPT: Keyword-Guided Pre-training for Grounded Dialog GenerationQi Zhu, Fei Mi, Zheng Zhang, Yasheng Wang et al.AAAI 2023 · 5 citations
- DukeNet: A Dual Knowledge Interaction Network for Knowledge-Grounded ConversationChuan Meng, Pengjie Ren, Zhumin Chen, Weiwei Sun et al.SIGIR 2020 · 42 citations
- Improving Open-Domain Dialogue Response Generation with Multi-Source Multilingual Commonsense KnowledgeSixing Wu, Jiong Yu, Jiahao Chen, Xiaofan Deng et al.AAAI 2024 · 5 citations
- Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue GenerationXiuyi Chen, Fandong Meng, Peng Li, Feilong Chen et al.EMNLP 2020 · 78 citations
- There Is No Standard Answer: Knowledge-Grounded Dialogue Generation with Adversarial Activated Multi-Reference LearningXueliang Zhao, Tingchen Fu, Chongyang Tao, Rui YanEMNLP 2022 · 2 citations
