GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation

The phenomenon of zero pronoun (ZP) has attracted increasing interest in the machine translation (MT) community due to its importance and difficulty. However, previous studies generally evaluate the quality of translating ZPs with BLEU scores on MT testsets, which are not expressive or sensitive enough for accurate assessment. To bridge the data and evaluation gaps, we propose a benchmark testset for target evaluation on Chinese-English ZP translation. The human-annotated testset covers five challenging genres, which reveal different characteristics of ZPs for comprehensive evaluation. We systematically revisit eight advanced models on ZP translation and identify current challenges for future exploration. We release data, code, models and annotation guidelines, which we hope can significantly promote research in this field. 1 * Mingzhou Xu and Longyue Wang contributed equally to this work. Work was done when Mingzhou Xu and Hongye Liu were interning at Tencent AI Lab. 1 https://github.com/longyuewangdcu/ mZPRT . Inp. 黄娟 Huang Juan, female, associate professor. Mainly teach the course Business English. Inp. A: 菲比 很 想 买 台 电视 。 B: 乔伊 不 让 (她) 买 (它) ？