Lune

EMNLP Findings2023

Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting

Ke Wang, Jun Xie, Yuqi Zhang, Yu Zhao

Abstract

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the performance with prompting. We propose a unified framework, which can integrate effectively multiple types of knowledge including sentences, terminologies/phrases and translation templates into NMT models. We utilize multiple types of knowledge as prefixprompts of input for the encoder and decoder of NMT models to guide the translation process. The approach requires no changes to the model architecture and effectively adapts to domain-specific translation without retraining. The experiments on English-Chinese and English-German translation demonstrate that our approach significantly outperform strong baselines, achieving high translation quality and terminology match accuracy.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on10

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Nearest Neighbor Machine TranslationUrvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer et al.ICLR 2021 · 323 citations
  3. Boosting Neural Machine Translation with Similar TranslationsJitao Xu, Josep Maria Crego, Jean SenellartACL 2020 · 59 citations
  4. Lexically Constrained Neural Machine Translation with Explicit Alignment GuidanceGuanhua Chen, Yun Chen, Victor O. K. LiAAAI 2021 · 29 citations
  5. Improving Neural Machine Translation with Soft Template PredictionJian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li et al.ACL 2020 · 29 citations

Related papers

  1. Prompting Neural Machine Translation with Translation MemoriesAbudurexiti Reheman, Tao Zhou, Yingfeng Luo, Di Yang et al.AAAI 2023 · 11 citations
  2. Augmenting Large Language Model Translators via Translation MemoriesYongyu Mu, Abudurexiti Reheman, Zhiquan Cao, Yuchun Fan et al.ACL Findings 2023 · 11 citations
  3. Acquiring Knowledge from Pre-Trained Model to Neural Machine TranslationRongxiang Weng, Heng Yu, Shujian Huang, Shanbo Cheng et al.AAAI 2020 · 71 citations
  4. Encoder and Decoder, Not One Less for Pre-trained Language Model Sponsored NMTSufeng Duan, Hai ZhaoACL Findings 2023 · 4 citations
  5. PromptNER: Prompt Locating and Typing for Named Entity RecognitionYongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang et al.ACL 2023 · 46 citations
Dusk over the sea between two cliffs drawn in fine vertical lines