ACL Findings2023
Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring
Heejin Do, Yunsu Kim, Gary Geunbae Lee
Abstract
Automated essay scoring (AES) aims to score essays written for a given prompt, which defines the writing topic. Most existing AES systems assume to grade essays of the same prompt as used in training and assign only a holistic score. However, such settings conflict with real-education situations; pre-graded essays for a particular prompt are lacking, and detailed trait scores of sub-rubrics are required. Thus, predicting various trait scores of unseenprompt essays (called cross-prompt essay trait scoring) is a remaining challenge of AES. In this paper, we propose a robust model: promptand trait relation-aware cross-prompt essay trait scorer. We encode prompt-aware essay representation by essay-prompt attention and utilizing the topic-coherence feature extracted by the topic-modeling mechanism without access to labeled data; therefore, our model considers the prompt adherence of an essay, even in a crossprompt setting. To facilitate multi-trait scoring, we design trait-similarity loss that encapsulates the correlations of traits. Experiments prove the efficacy of our model, showing state-of-theart results for all prompts and traits. Significant improvements in low-resource-prompt and inferior traits further indicate our model's strength.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 12 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers12
- Automated Essay Scoring: A Reflection on the State of the ArtShengjie Li, Vincent NgEMNLP 2024 · 16 citations
- DREsS: Dataset for Rubric-based Essay Scoring on EFL WritingHaneul Yoo, Jieun Han, So-Yeon Ahn, Alice OhACL 2025 · 13 citations
- Cross-Prompt Automated Essay Scoring of Multiple Traits: Making Sense of the State of the ArtShengjie Li, Vincent NgACL 2026 · 10 citations
- Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the ArtShengjie Li, Vincent NgACL 2024 · 8 citations
- KAES: Multi-aspect Shared Knowledge Finding and Aligning for Cross-prompt Automated Scoring of Essay TraitsXia Li, Wenjing PanAAAI 2025 · 5 citations
Builds on1
Related papers
- TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay ScoringSohaila Eltanbouly, Salam Albatarni, Tamer ElsayedACL Findings 2025 · 7 citations
- Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance PerspectiveJiong Wang, Shengquan YuEMNLP Findings 2025 · 1 citation
- Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation LearningZhiwei Jiang, Tianyi Gao, Yafeng Yin, Meng Liu et al.ACL 2023 · 16 citations
- Multi-Stage Pre-training for Automated Chinese Essay ScoringWei Song, Kai Zhang, Ruiji Fu, Lizhen Liu et al.EMNLP 2020 · 28 citations
- PMAES: Prompt-mapping Contrastive Learning for Cross-prompt Automated Essay ScoringYuan Chen, Xia LiACL 2023 · 20 citations
