Incentivizing Parametric Knowledge via Reinforcement Learning with Verifiable Rewards for Cross-Cultural Entity Translation
Jiang Zhou, Xiaohu Zhao, Xinwei Wu, Tianyu Dong, Hao Wang, Yangyang Liu, Heng Liu, Linlong Xu, Longyue Wang, Weihua Luo, Deyi Xiong
Abstract
Cross-cultural entity translation remains challenging for large language models (LLMs) as literal or phonetic renderings are usually yielded instead of culturally appropriate translations in context. However, relevant knowledge may already be encoded in model parameters during large-scale pre-training. To incentivize the effective use of parametric knowledge, we propose EA-RLVR (Entity-Anchored Reinforcement Learning with Verifiable Rewards), a training framework that optimizes cross-cultural entity translation without relying on external knowledge bases. EA-RLVR anchors supervision on a verifiable, entity-level reward signal and incorporates lightweight structural gates to stabilize optimization. This design steers the model toward learning a robust reasoning process rather than merely imitating reference translations. We evaluate EA-RLVR on XC-Translate and observe consistent improvements in both entity translation accuracy and out-of-domain generalization. Specifically, training on merely 7k samples boosts Qwen3-14B's entity translation accuracy from 23.66% to 31.87% on a 50k test set comprising entirely unseen entities. The learned entity translation ability also transfers to general translation, yielding +1.35 XCOMET on WMT24++, which scales to +1.59 with extended optimization. Extensive analyses of dynamics and reward formulations attribute these gains to superior sampling efficiency and a stable optimization landscape.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7ea2639f-4f2e-4a05-807a-5a726967f56fCited by top-tier papers1
Ask how each one uses itBuilds on10
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessTri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra et al.NeurIPS 2022 · 5,493 citations
- Nearest Neighbor Machine TranslationUrvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer et al.ICLR 2021 · 323 citations
- HybridFlow: A Flexible and Efficient RLHF FrameworkGuangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu et al.EuroSys 2025 · 61 citations
- CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language ModelsRunpeng Dai, Linfeng Song, Haolin Liu, Zhenwen Liang et al.ICLR 2026 · 29 citations
- DAPO : Improving Multi-Step Reasoning Abilities of Large Language Models with Direct Advantage-Based Policy OptimizationJiacai Liu, Chaojie Wang, Chris Yuhao Liu, Liang Zeng et al.NeurIPS 2025 · 9 citations
Related papers
- LongRLVR: Long-Context Reinforcement Learning Requires Verifiable Context RewardsGuanzheng Chen, Michael Qizhe Shieh, Lidong BingICLR 2026 · 18 citations
- Crossing the Reward Bridge: Expanding Reinforcement Learning with Verifiable Rewards Across Diverse DomainsYi Su, Dian Yu, Linfeng Song, Juntao Li et al.ACL 2026
- Generalization of RLVR Using Causal Reasoning as a TestbedZhichu Lu, Hongyu Zhao, Shuo Sun, Hao Peng et al.ICLR 2026 · 4 citations
- PretrainZero: Reinforcement Active Learning on Pretraining DataXingrun Xing, Zhiyuan Fan, Jie Lou, Guoqi Li et al.ICML 2026
- Beyond English-Centric Training: How Reinforcement Learning Improves Cross-Lingual Reasoning in LLMsShulin Huang, Yiran Ding, Junshu Pan, Yue ZhangICLR 2026 · 11 citations
