DREsS: Dataset for Rubric-based Essay Scoring on EFL Writing
Haneul Yoo, Jieun Han, So-Yeon Ahn, Alice Oh
Abstract
Automated essay scoring (AES) is a useful tool in English as a Foreign Language (EFL) writing education, offering real-time essay scores for students and instructors. However, previous AES models were trained on essays and scores irrelevant to the practical scenarios of EFL writing education and usually provided a single holistic score due to the lack of appropriate datasets. In this paper, we release DREsS, a large-scale, standard dataset for rubric-based automated essay scoring with 48.9K samples in total. DREsS comprises three sub-datasets: DREsS New , DREsS Std. , and DREsS CASE . We collect DREsS New , a real-classroom dataset with 2.3K essays authored by EFL undergraduate students and scored by English education experts. We also standardize existing rubricbased essay scoring datasets as DREsS Std. . We suggest CASE, a corruption-based augmentation strategy for essays, which generates 40.1K synthetic samples of DREsS CASE and improves the baseline results by 45.44%. DREsS will enable further research to provide a more accurate and practical AES system for EFL writing education. 1 1. DREsS_New (2,279 samples) EFL classroom data: 1) Student-written essays 2) Rubric-based scores assessed by instructors 2. DREsS_Std. (6,515 samples) Unified AES datasets with standardized rubrics under professional consultation Corruption 3. DREsS_CASE (40,185 samples) Synthetic essay samples generated by CASE, our proposed augmentation strategy
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e61cd885-e5c5-4164-98f9-b023459b1e17Cited by top-tier papers2
- Authorship Drift: How Self-Efficacy and Trust Evolve During LLM-Assisted WritingYeon Su Park, Nadia Azzahra Putri Arvi, Seoyoung Kim, Juho KimCHI 2026 · 3 citations
- STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and BeyondNils Dycke, Matej Zecevic, Ilia Kuznetsov, Beatrix Suess et al.ACL 2025
Builds on4
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
- Multi-Stage Pre-training for Automated Chinese Essay ScoringWei Song, Kai Zhang, Ruiji Fu, Lizhen Liu et al.EMNLP 2020 · 28 citations
- PMAES: Prompt-mapping Contrastive Learning for Cross-prompt Automated Essay ScoringYuan Chen, Xia LiACL 2023 · 20 citations
- TCFLE-8: a Corpus of Learner Written Productions for French as a Foreign Language and its Application to Automated Essay ScoringRodrigo Wilkens, Alice Pintard, David Alfter, Vincent Folny et al.EMNLP 2023
Related papers
- Automated Cross-prompt Scoring of Essay TraitsRobert Ridley, Liang He, Xin-Yu Dai, Shujian Huang et al.AAAI 2021 · 101 citations
- Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation LearningZhiwei Jiang, Tianyi Gao, Yafeng Yin, Meng Liu et al.ACL 2023 · 16 citations
- Mixture of Ordered Scoring Experts for Cross-prompt Essay Trait ScoringPo-Kai Chen, Bo-Wei Tsai, Shao-Kuan Wei, Chien-Yao Wang et al.ACL 2025
- Domain-Adaptive Neural Automated Essay ScoringYue Cao, Hanqi Jin, Xiaojun Wan, Zhiwei YuSIGIR 2020 · 47 citations
- Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple RewardsHeejin Do, Sangwon Ryu, Gary Geunbae LeeEMNLP 2024 · 5 citations
