EMNLP Findings2025
SubDocTrans: Enhancing Document-level Machine Translation with Plug-and-play Multi-granularity Knowledge Augmentation
Hanghai Hong, Yibo Xie, Jiawei Zheng, Xiaoli Wang
Abstract
Large language models (LLMs) have recently achieved remarkable progress in sentence-level machine translation, but scaling to documentlevel machine translation (DocMT) remains challenging, particularly in modeling contexts and discourse phenomena across sentences and paragraphs. Document translations generated by LLMs often suffer from poor consistency, weak coherence, and omission errors. To address the issues, we propose a novel DocMT framework named SubDocTrans, that enables LLMs to produce high-quality translations via plug-and-play multi-granularity knowledge augmentation. SubDocTrans first performs topic segmentation to divide a document into coherent sub-documents, enabling efficient document-level translation while preserving contextual coherence. For each sub-document, both global and local knowledge are extracted including bilingual summary, theme, proper nouns, topics, and transition hint. We then incorporate the multi-granularity knowledge into the prompting strategy, to guide LLMs in producing consistent, coherent, and accurate translations. We also conduct extensive experiments across various DocMT tasks, and the results demonstrate the effectiveness of our framework, particularly in improving consistency and coherence, reducing omission errors, and mitigating hallucinations.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on10
- Finetuned Language Models are Zero-Shot LearnersJason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu et al.ICLR 2022 · 4,966 citations
- Document-Level Machine Translation with Large Language ModelsLongyue Wang, Chenyang Lyu, Tianbo Ji, Zhirui Zhang et al.EMNLP 2023 · 129 citations
- Rethinking Document-level Neural Machine TranslationZewei Sun, Mingxuan Wang, Hao Zhou, Chengqi Zhao et al.ACL Findings 2022 · 45 citations
- Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even BetterDavid Dale, Elena Voita, Loïc Barrault, Marta R. Costa-jussàACL 2023 · 25 citations
- Encouraging Lexical Translation Consistency for Document-Level Neural Machine TranslationXinglin Lyu, Junhui Li, Zhengxian Gong, Min ZhangEMNLP 2021 · 17 citations
Related papers
- Efficiently Exploring Large Language Models for Document-Level Machine Translation with In-context LearningMenglong Cui, Jiangcun Du, Shaolin Zhu, Deyi XiongACL Findings 2024 · 12 citations
- DelTA: An Online Document-Level Translation Agent Based on Multi-Level MemoryYutong Wang, Jiali Zeng, Xuebo Liu, Derek F. Wong et al.ICLR 2025
- Two Intermediate Translations Are Better Than One: Fine-tuning LLMs for Document-level Translation RefinementYichen Dong, Xinglin Lyu, Junhui Li, Daimeng Wei et al.ACL 2025
- Towards Demonstration-Aware Large Language Models for Machine TranslationChen Li, Meishan Zhang, Xuebo Liu, Zhaocong Li et al.ACL Findings 2024 · 2 citations
- AdaDPI: Document-level Translation Adaptive Agent via Dynamic Parametric InternalizationHong Ren, Liting Deng, Shaolin Zhu, Deyi XiongACL 2026
