ACL Findings2025
IMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator
Yusuke Sakai, Takumi Goto, Taro Watanabe
Abstract
We propose IMPARA-GED, a novel reference-free automatic grammatical error correction (GEC) evaluation method with grammatical error detection (GED) capabilities. We focus on the quality estimator of IMPARA, an existing automatic GEC evaluation method, and construct that of IMPARA-GED using a pre-trained language model with enhanced GED capabilities. Experimental results on SEEDA, a meta-evaluation dataset for automatic GEC evaluation methods, demonstrate that IMPARA-GED achieves the highest correlation with human sentence-level evaluations.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on5
- Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller et al.ACL 2025 · 552 citations
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu ChenICLR 2023 · 394 citations
- Multi-Class Grammatical Error Detection for Correction: A Tale of Two SystemsZheng Yuan, Shiva Taslimipoor, Christopher Davis, Christopher BryantEMNLP 2021 · 28 citations
- Revisiting Grammatical Error Correction Evaluation and BeyondPeiyuan Gong, Xuebo Liu, Heyan Huang, Min ZhangEMNLP 2022 · 11 citations
- System Combination via Quality Estimation for Grammatical Error CorrectionMuhammad Reza Qorib, Hwee Tou NgEMNLP 2023 · 8 citations
Related papers
- Reliability Crisis of Reference-free Metrics for Grammatical Error CorrectionTakumi Goto, Yusuke Sakai, Taro WatanabeEMNLP Findings 2025
- DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language ModelsJinxiang Xie, Yilin Li, Xunjian Yin, Xiaojun WanAAAI 2025 · 2 citations
- Zero-shot Cross-Lingual Transfer for Synthetic Data Generation in Grammatical Error DetectionGaetan Latouche, Marc-André Carbonneau, Benjamin SwansonEMNLP 2024 · 1 citation
- JELV: A Judge of Edit-Level Validity for Evaluation and Automated Reference Expansion in Grammatical Error CorrectionYuhao Zhan, Yuqing Zhang, Jing Yuan, Qixiang Ma et al.AAAI 2026
- Grammatical Error Correction in Low Error Density Domains: A New Benchmark and AnalysesSimon Flachs, Ophélie Lacroix, Helen Yannakoudakis, Marek Rei et al.EMNLP 2020
