EMNLP Findings2024
Towards Explainable Chinese Native Learner Essay Fluency Assessment: Dataset, Tasks, and Method
Xinshu Shen, Hongyi Wu, Yadong Zhang, Man Lan, Xiaopeng Bai, Shaoguang Mao, Yuanbin Wu, Xinlin Zhuang, Li Cai
Abstract
Grammatical Error Correction (GEC) is a crucial technique in Automated Essay Scoring (AES) for evaluating the fluency of essays.However, in Chinese, existing GEC datasets often fail to consider the importance of specific grammatical error types within compositional scenarios, lack research on data collected from native Chinese speakers, and largely overlook cross-sentence grammatical errors.Furthermore, the measurement of the overall fluency of an essay is often overlooked.To address these issues, we present CEFA (Chinese Essay Fluency Assessment), an extensive corpus that is derived from essays authored by native Chinese-speaking primary and secondary students and encapsulates essay fluency scores along with both coarse and fine-grained grammatical error types and corrections.Experiments employing various benchmark models on CEFA substantiate the challenge of our dataset.Our findings further highlight the significance of fine-grained annotations in fluency assessment and the mutually beneficial relationship between error types and corrections 1 .
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on8
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, Bing Qin et al.EMNLP Findings 2020 · 866 citations
- FCGEC: Fine-Grained Corpus for Chinese Grammatical Error CorrectionLvxiaowei Xu, Jianwang Wu, Jiawei Peng, Jiayu Fu et al.EMNLP Findings 2022 · 21 citations
- NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker TextsYue Zhang, Bo Zhang, Haochen Jiang, Zhenghua Li et al.ACL Findings 2023 · 11 citations
Related papers
- Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error CorrectionShirong Ma, Yinghui Li, Rongyi Sun, Qingyu Zhou et al.EMNLP Findings 2022 · 27 citations
- ScholarGEC: Enhancing Controllability of Large Language Model for Chinese Academic Grammatical Error CorrectionZixiao Kong, Xianquan Wang, Shuanghong Shen, Keyu Zhu et al.AAAI 2025 · 2 citations
- Grammatical Error Correction in Low Error Density Domains: A New Benchmark and AnalysesSimon Flachs, Ophélie Lacroix, Helen Yannakoudakis, Marek Rei et al.EMNLP 2020
- From Spelling to Grammar: A New Framework for Chinese Grammatical Error CorrectionXiuyu Wu, Yunfang WuEMNLP Findings 2022 · 8 citations
- A Training-free LLM-based Approach to General Chinese Character Error CorrectionHouquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan et al.ACL 2025
