EMNLP Findings2024
Towards Explainable Chinese Native Learner Essay Fluency Assessment: Dataset, Tasks, and Method
Xinshu Shen, Hongyi Wu, Yadong Zhang, Man Lan, Xiaopeng Bai, Shaoguang Mao, Yuanbin Wu, Xinlin Zhuang, Li Cai
摘要
Grammatical Error Correction (GEC) is a crucial technique in Automated Essay Scoring (AES) for evaluating the fluency of essays.However, in Chinese, existing GEC datasets often fail to consider the importance of specific grammatical error types within compositional scenarios, lack research on data collected from native Chinese speakers, and largely overlook cross-sentence grammatical errors.Furthermore, the measurement of the overall fluency of an essay is often overlooked.To address these issues, we present CEFA (Chinese Essay Fluency Assessment), an extensive corpus that is derived from essays authored by native Chinese-speaking primary and secondary students and encapsulates essay fluency scores along with both coarse and fine-grained grammatical error types and corrections.Experiments employing various benchmark models on CEFA substantiate the challenge of our dataset.Our findings further highlight the significance of fine-grained annotations in fluency assessment and the mutually beneficial relationship between error types and corrections 1 .
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper8
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 18,833 次引用
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger 等ICLR 2020 · 8,443 次引用
- Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, Bing Qin 等EMNLP Findings 2020 · 866 次引用
- FCGEC: Fine-Grained Corpus for Chinese Grammatical Error CorrectionLvxiaowei Xu, Jianwang Wu, Jiawei Peng, Jiayu Fu 等EMNLP Findings 2022 · 21 次引用
- NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker TextsYue Zhang, Bo Zhang, Haochen Jiang, Zhenghua Li 等ACL Findings 2023 · 11 次引用
相关 Paper
- Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error CorrectionShirong Ma, Yinghui Li, Rongyi Sun, Qingyu Zhou 等EMNLP Findings 2022 · 27 次引用
- ScholarGEC: Enhancing Controllability of Large Language Model for Chinese Academic Grammatical Error CorrectionZixiao Kong, Xianquan Wang, Shuanghong Shen, Keyu Zhu 等AAAI 2025 · 2 次引用
- Grammatical Error Correction in Low Error Density Domains: A New Benchmark and AnalysesSimon Flachs, Ophélie Lacroix, Helen Yannakoudakis, Marek Rei 等EMNLP 2020
- From Spelling to Grammar: A New Framework for Chinese Grammatical Error CorrectionXiuyu Wu, Yunfang WuEMNLP Findings 2022 · 8 次引用
- A Training-free LLM-based Approach to General Chinese Character Error CorrectionHouquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan 等ACL 2025
