Lune

EMNLP Findings2024

Towards Explainable Chinese Native Learner Essay Fluency Assessment: Dataset, Tasks, and Method

Xinshu Shen, Hongyi Wu, Yadong Zhang, Man Lan, Xiaopeng Bai, Shaoguang Mao, Yuanbin Wu, Xinlin Zhuang, Li Cai

Abstract

Grammatical Error Correction (GEC) is a crucial technique in Automated Essay Scoring (AES) for evaluating the fluency of essays.However, in Chinese, existing GEC datasets often fail to consider the importance of specific grammatical error types within compositional scenarios, lack research on data collected from native Chinese speakers, and largely overlook cross-sentence grammatical errors.Furthermore, the measurement of the overall fluency of an essay is often overlooked.To address these issues, we present CEFA (Chinese Essay Fluency Assessment), an extensive corpus that is derived from essays authored by native Chinese-speaking primary and secondary students and encapsulates essay fluency scores along with both coarse and fine-grained grammatical error types and corrections.Experiments employing various benchmark models on CEFA substantiate the challenge of our dataset.Our findings further highlight the significance of fine-grained annotations in fluency assessment and the mutually beneficial relationship between error types and corrections 1 .

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on8

  1. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
  2. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  3. Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, Bing Qin et al.EMNLP Findings 2020 · 866 citations
  4. FCGEC: Fine-Grained Corpus for Chinese Grammatical Error CorrectionLvxiaowei Xu, Jianwang Wu, Jiawei Peng, Jiayu Fu et al.EMNLP Findings 2022 · 21 citations
  5. NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker TextsYue Zhang, Bo Zhang, Haochen Jiang, Zhenghua Li et al.ACL Findings 2023 · 11 citations

Related papers

  1. Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error CorrectionShirong Ma, Yinghui Li, Rongyi Sun, Qingyu Zhou et al.EMNLP Findings 2022 · 27 citations
  2. ScholarGEC: Enhancing Controllability of Large Language Model for Chinese Academic Grammatical Error CorrectionZixiao Kong, Xianquan Wang, Shuanghong Shen, Keyu Zhu et al.AAAI 2025 · 2 citations
  3. Grammatical Error Correction in Low Error Density Domains: A New Benchmark and AnalysesSimon Flachs, Ophélie Lacroix, Helen Yannakoudakis, Marek Rei et al.EMNLP 2020
  4. From Spelling to Grammar: A New Framework for Chinese Grammatical Error CorrectionXiuyu Wu, Yunfang WuEMNLP Findings 2022 · 8 citations
  5. A Training-free LLM-based Approach to General Chinese Character Error CorrectionHouquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan et al.ACL 2025
Dusk over the sea between two cliffs drawn in fine vertical lines