Lune

EMNLP Findings2022

From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correction

Xiuyu Wu, Yunfang Wu

Abstract

Chinese Grammatical Error Correction (CGEC) aims to generate a correct sentence from an erroneous sequence, where different kinds of errors are mixed. This paper divides the CGEC task into two steps, namely spelling error correction and grammatical error correction. Specially, we propose a novel zero-shot approach for spelling error correction, which is simple but effective, obtaining a high precision to avoid error accumulation of the pipeline structure. To handle grammatical error correction, we design part-of-speech (POS) features and semantic class features to enhance the neural network model, and propose an auxiliary task to predict the POS sequence of the target sentence. Our proposed framework achieves a 42.11 F 0 .5 score on CGEC dataset without using any synthetic data or data augmentation methods, which outperforms the previous state-of-the-art by a wide margin of 1.30 points. Moreover, our model produces meaningful POS representations that capture different POS words and convey reasonable POS transition rules.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 3 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers3

  1. Unsupervised Grammatical Error Correction Rivaling Supervised MethodsHannan Cao, Liping Yuan, Yuchen Zhang, Hwee Tou NgEMNLP 2023 · 4 citations
  2. Multi-pass Decoding for Grammatical Error CorrectionXiaoying Wang, Lingling Mu, Jingyi Zhang, Hongfei XuEMNLP 2024 · 2 citations
  3. Intuitive Thinking: Expanding Large Language Models' Thinking for Rapid Decision-Making on Candidate Corrections in Chinese Grammar Error CorrectionLintao Long, Ruizhang Huang, Ruina Bai, Yongbin Qin et al.AAAI 2026

Builds on6

  1. Spelling Error Correction with Soft-Masked BERTShaohua Zhang, Haoran Huang, Jicong Liu, Hang LiACL 2020 · 204 citations
  2. SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling CheckXingyi Cheng, Weidi Xu, Kunlong Chen, Shaohua Jiang et al.ACL 2020 · 139 citations
  3. MaskGEC: Improving Neural Grammatical Error Correction via Dynamic MaskingZewei Zhao, Houfeng WangAAAI 2020 · 71 citations
  4. Sequence-to-Action: Grammatical Error Correction with Action Guided Sequence GenerationJiquan Li, Junliang Guo, Yongxin Zhu, Xin Sheng et al.AAAI 2022 · 29 citations
  5. PHMOSpell: Phonological and Morphological Knowledge Guided Chinese Spelling CheckLi Huang, Junjie Li, Weiwei Jiang, Zhiyu Zhang et al.ACL 2021

Related papers

  1. An Error-Guided Correction Model for Chinese Spelling Error CorrectionRui Sun, Xiuyu Wu, Yunfang WuEMNLP Findings 2022 · 15 citations
  2. Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error CorrectionPiji Li, Shuming ShiACL 2021
  3. Improving Autoregressive Grammatical Error Correction with Non-autoregressive ModelsHang Cao, Zhiquan Cao, Chi Hu, Baoyu Hou et al.ACL Findings 2023 · 1 citation
  4. Chinese Spelling Correction as Rephrasing Language ModelLinfeng Liu, Hongqiu Wu, Hai ZhaoAAAI 2024 · 36 citations
  5. LET: Leveraging Error Type Information for Grammatical Error CorrectionLingyu Yang, Hongjia Li, Lei Li, Chengyin Xu et al.ACL Findings 2023 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines