Lune

ACL Findings2025

TRANS-ZERO: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Data

Wei Zou, Sen Yang, Yu Bao, Shujian Huang, Jiajun Chen, Shanbo Cheng

Abstract

The rise of Large Language Models (LLMs) has reshaped machine translation (MT), but multilingual MT still relies heavily on parallel data for supervised fine-tuning (SFT), facing challenges like data scarcity for lowresource languages and catastrophic forgetting. To address these issues, we propose TRANS-ZERO, a self-play framework that leverages only monolingual data and the intrinsic multilingual knowledge of LLM. TRANS-ZERO combines a novel Monte-Carlo Tree Search, G-MCTS, with preference optimization, achieving strong translation performance that rivals supervised methods. Experiments demonstrate that this approach not only matches the performance of models trained on large-scale parallel data but also excels in non-English translation directions. Further analysis reveals that G-MCTS itself significantly enhances translation quality by exploring semantically consistent candidates through iterative translations, providing a robust foundation for the framework's success. Codes are available at https: //github.com/NJUNLP/trans0

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 2 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers2

  1. DuPO: Enabling Reliable Self-Verification via Dual Preference OptimizationShuaijie She, Yu Bao, Yu Lu, Lu Xu et al.ICLR 2026 · 3 citations
  2. Improving Long-Context Translation via Self-Supervised Dual LearningShanbo Cheng, Shuaijie She, Yu Bao, Jianbing Zhang et al.ACL 2026

Builds on9

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree SearchDan Zhang, Sining Zhoubian, Ziniu Hu, Yisong Yue et al.NeurIPS 2024 · 527 citations
  3. Self-Play Fine-Tuning Converts Weak Language Models to Strong Language ModelsZixiang Chen, Yihe Deng, Huizhuo Yuan, Kaixuan Ji et al.ICML 2024 · 527 citations
  4. Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine TranslationHaoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan et al.ICML 2024 · 447 citations
  5. Large Language Models Can Self-ImproveJiaxin Huang, Shixiang Gu, Le Hou, Yuexin Wu et al.EMNLP 2023 · 184 citations

Related papers

  1. CLewR: Curriculum Learning with Restarts for Machine Translation Preference LearningAlexandra Dragomir, Florin Brad, Radu Tudor IonescuACL Findings 2026
  2. LANDeRMT: Dectecting and Routing Language-Aware Neurons for Selectively Finetuning LLMs to Machine TranslationShaolin Zhu, Leiyu Pan, Bo Li, Deyi XiongACL 2024
  3. Multilingual Translation from Denoising Pre-TrainingYuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen et al.ACL Findings 2021 · 99 citations
  4. LLMs Are Zero-Shot Context-Aware Simultaneous TranslatorsRoman Koshkin, Katsuhito Sudoh, Satoshi NakamuraEMNLP 2024
  5. MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement LearningZhaopeng Feng, Shaosheng Cao, Jiahan Ren, Jiayuan Su et al.EMNLP Findings 2025 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines