Lune

EMNLP Findings2023

Quality Estimation-Assisted Automatic Post-Editing

Sourabh Dattatray Deoghare, Diptesh Kanojia, Frédéric Blain, Tharindu Ranasinghe, Pushpak Bhattacharyya

Abstract

Automatic Post-Editing (APE) systems are prone to over-correction of the Machine Translation (MT) outputs. While a Word-level Quality Estimation (QE) system can provide a way to curtail the over-correction, a significant performance gain has not been observed thus far by utilizing existing APE and QE combination strategies. This paper proposes joint training of a model over QE (sentence-and word-level) and APE tasks to improve the APE. Our proposed approach utilizes a multi-task learning (MTL) methodology, which shows significant improvement while treating the tasks as a 'bargaining game' during training. Moreover, we investigate various existing combination strategies and show that our approach achieves stateof-the-art performance for a 'distant' language pair, viz., English-Marathi. We observe an improvement of 1.09 TER and 1.37 BLEU points over a baseline QE-Unassisted APE system for English-Marathi while also observing 0.46 TER and 0.62 BLEU points improvement for English-German. Further, we discuss the results qualitatively and show how our approach helps reduce over-correction, thereby improving the APE performance. We also observe that the degree of integration between QE and APE directly correlates with the APE performance gain. We release our code publicly 1 .

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 2 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers2

  1. What do Large Language Models Need for Machine Translation Evaluation?Shenbin Qian, Archchana Sindhujan, Minnie Kabra, Diptesh Kanojia et al.EMNLP 2024 · 4 citations
  2. Are Generative Models Underconfident? Better Quality Estimation with Boosted Model ProbabilityTu Anh Dinh, Jan NiehuesEMNLP 2025

Builds on4

  1. Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
  2. iNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian LanguagesDivyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, Gokul N. C. et al.EMNLP Findings 2020 · 465 citations
  3. Multi-Task Learning as a Bargaining GameAviv Navon, Aviv Shamsian, Idan Achituve, Haggai Maron et al.ICML 2022 · 243 citations
  4. Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan et al.ACL 2022

Related papers

  1. Together We Can: Multilingual Automatic Post-Editing for Low-Resource LanguagesSourabh Dattatray Deoghare, Diptesh Kanojia, Pushpak BhattacharyyaEMNLP Findings 2024 · 1 citation
  2. A Multi-task Learning Framework for Quality EstimationSourabh Dattatray Deoghare, Paramveer Choudhary, Diptesh Kanojia, Tharindu Ranasinghe et al.ACL Findings 2023
  3. Computer Assisted Translation with Neural Quality Estimation and Auotmatic Post-EditingKe Wang, Jiayi Wang, Niyu Ge, Yangbin Shi et al.EMNLP Findings 2020 · 5 citations
  4. Can Automatic Post-Editing Improve NMT?Shamil Chollampatt, Raymond Hendy Susanto, Liling Tan, Ewa SzymanskaEMNLP 2020 · 1 citation
  5. Bias Mitigation in Machine Translation Quality EstimationHanna Behnke, Marina Fomicheva, Lucia SpeciaACL 2022
Dusk over the sea between two cliffs drawn in fine vertical lines