EMNLP Findings2023
Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting
Ke Wang, Jun Xie, Yuqi Zhang, Yu Zhao
摘要
Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the performance with prompting. We propose a unified framework, which can integrate effectively multiple types of knowledge including sentences, terminologies/phrases and translation templates into NMT models. We utilize multiple types of knowledge as prefixprompts of input for the encoder and decoder of NMT models to guide the translation process. The approach requires no changes to the model architecture and effectively adapts to domain-specific translation without retraining. The experiments on English-Chinese and English-German translation demonstrate that our approach significantly outperform strong baselines, achieving high translation quality and terminology match accuracy.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper10
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 64,255 次引用
- Nearest Neighbor Machine TranslationUrvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer 等ICLR 2021 · 323 次引用
- Boosting Neural Machine Translation with Similar TranslationsJitao Xu, Josep Maria Crego, Jean SenellartACL 2020 · 59 次引用
- Lexically Constrained Neural Machine Translation with Explicit Alignment GuidanceGuanhua Chen, Yun Chen, Victor O. K. LiAAAI 2021 · 29 次引用
- Improving Neural Machine Translation with Soft Template PredictionJian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li 等ACL 2020 · 29 次引用
相关 Paper
- Prompting Neural Machine Translation with Translation MemoriesAbudurexiti Reheman, Tao Zhou, Yingfeng Luo, Di Yang 等AAAI 2023 · 11 次引用
- Augmenting Large Language Model Translators via Translation MemoriesYongyu Mu, Abudurexiti Reheman, Zhiquan Cao, Yuchun Fan 等ACL Findings 2023 · 11 次引用
- Acquiring Knowledge from Pre-Trained Model to Neural Machine TranslationRongxiang Weng, Heng Yu, Shujian Huang, Shanbo Cheng 等AAAI 2020 · 71 次引用
- Encoder and Decoder, Not One Less for Pre-trained Language Model Sponsored NMTSufeng Duan, Hai ZhaoACL Findings 2023 · 4 次引用
- PromptNER: Prompt Locating and Typing for Named Entity RecognitionYongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang 等ACL 2023 · 46 次引用
