ACL Findings2026
NSL-MT: Linguistically Informed Negative Samples for Efficient Machine Translation in African Low-Resource Languages
Mamadou K. Keita, Christopher M. Homan, Huy Le
摘要
We introduce negative space learning machine translation (NSL-MT), a training method for underresourced languages, that augments limited parallel data with synthetically generated violations of the target language's grammar and explicitly penalizes the model when it assigns high probability to these linguistically invalid outputs. NSL-MT delivers improvements across all baselines we tested, including 3-12% BLEU gains for well-performing models and 56-89% gains for models lacking decent initial support. Furthermore, NSL-MT provides a 5x data efficiency multiplier: training with 1,000 examples matches or exceeds normal training with 5,000 examples. NSL-MT thus provides a data-efficient alternative training method for settings where parallel data is limited.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper5
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 次引用
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 10,924 次引用
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 次引用
- COMET: A Neural Framework for MT EvaluationRicardo Rei, Craig Stewart, Ana C. Farinha, Alon LavieEMNLP 2020 · 6 次引用
- Analyzing the Effect of Linguistic Similarity on Cross-Lingual Transfer: Tasks and Experimental Setups MatterVerena Blaschke, Masha Fedzechkina, Maartje ter HoeveACL Findings 2025 · 3 次引用
相关 Paper
- Leveraging Synthetic Targets for Machine TranslationSarthak Mittal, Oleksii Hrinchuk, Oleksii KuchaievACL Findings 2023 · 1 次引用
- Alternated Training with Synthetic and Authentic Data for Neural Machine TranslationRui Jiao, Zonghan Yang, Maosong Sun, Yang LiuACL Findings 2021 · 9 次引用
- Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel DataWei-Jen Ko, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary 等ACL 2021
- AdvAug: Robust Adversarial Augmentation for Neural Machine TranslationYong Cheng, Lu Jiang, Wolfgang Macherey, Jacob EisensteinACL 2020 · 105 次引用
- Target-Side Augmentation for Document-Level Machine TranslationGuangsheng Bao, Zhiyang Teng, Yue ZhangACL 2023 · 9 次引用
