Lune

EMNLP Findings2020

Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields

Jingxuan Yang, Kerui Xu, Jun Xu, Si Li, Sheng Gao, Jun Guo, Ji-Rong Wen, Nianwen Xue

Abstract

Pronouns are often dropped in Chinese conversations and recovering the dropped pronouns is important for NLP applications such as Machine Translation. Existing approaches usually formulate this as a sequence labeling task of predicting whether there is a dropped pronoun before each token and its type. Each utterance is considered to be a sequence and labeled independently. Although these approaches have shown promise, labeling each utterance independently ignores the dependencies between pronouns in neighboring utterances. Modeling these dependencies is critical to improving the performance of dropped pronoun recovery. In this paper, we present a novel framework that combines the strength of Transformer network with General Conditional Random Fields (GCRF) to model the dependencies between pronouns in neighboring utterances. Results on three Chinese conversation datasets show that the Transformer-GCRF model outperforms the state-of-the-art dropped pronoun recovery models. Exploratory analysis also demonstrates that the GCRF did help to capture the dependencies between pronouns in neighboring utterances, thus contributes to the performance improvements.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. Coupling Context Modeling with Zero Pronoun Recovering for Document-Level Natural Language GenerationXin Tan, Longyin Zhang, Guodong ZhouEMNLP 2021 · 6 citations
  2. A Joint Model for Dropped Pronoun Recovery and Conversational Discourse Parsing in Chinese Conversational SpeechJingxuan Yang, Kerui Xu, Jun Xu, Si Li et al.ACL 2021

Related papers

  1. PROSE: A Pronoun Omission Solution for Chinese-English Spoken Language TranslationKe Wang, Xiutian Zhao, Yanghui Li, Wei PengEMNLP 2023 · 2 citations
  2. Hierarchical Attention Network with Pairwise Loss for Chinese Zero Pronoun ResolutionPeiqin Lin, Meng YangAAAI 2020 · 9 citations
  3. A Survey on Zero Pronoun TranslationLongyue Wang, Siyou Liu, Mingzhou Xu, Linfeng Song et al.ACL 2023 · 5 citations
  4. An Alignment-Agnostic Model for Chinese Text Error CorrectionLiying Zheng, Yue Deng, Weishun Song, Liang Xu et al.EMNLP Findings 2021 · 6 citations
  5. Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error CorrectionPiji Li, Shuming ShiACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines