ACL Findings2025
TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring
Sohaila Eltanbouly, Salam Albatarni, Tamer Elsayed
Abstract
Research on holistic Automated Essay Scoring (AES) is long-dated; yet, there is a notable lack of attention for assessing essays according to individual traits. In this work, we propose TRATES, a novel trait-specific and rubricbased cross-prompt AES framework that is generic yet specific to the underlying trait. The framework leverages a Large Language Model (LLM) that utilizes the trait grading rubrics to generate trait-specific features (represented by assessment questions), then assesses those features given an essay. The trait-specific features are eventually combined with generic writingquality and prompt-specific features to train a simple classical regression model that predicts trait scores of essays from an unseen prompt. Experiments show that TRATES achieves a new state-of-the-art performance across all traits on a widely-used dataset, with the generated LLMbased features being the most significant.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on7
- SimPO: Simple Preference Optimization with a Reference-Free RewardYu Meng, Mengzhou Xia, Danqi ChenNeurIPS 2024 · 1,203 citations
- Automated Cross-prompt Scoring of Essay TraitsRobert Ridley, Liang He, Xin-Yu Dai, Shujian Huang et al.AAAI 2021 · 101 citations
- Unleashing Large Language Models' Proficiency in Zero-shot Essay ScoringSanwoo Lee, Yida Cai, Desong Meng, Ziyang Wang et al.EMNLP Findings 2024 · 41 citations
- Prompt- and Trait Relation-aware Cross-prompt Essay Trait ScoringHeejin Do, Yunsu Kim, Gary Geunbae LeeACL Findings 2023 · 29 citations
- PMAES: Prompt-mapping Contrastive Learning for Cross-prompt Automated Essay ScoringYuan Chen, Xia LiACL 2023 · 20 citations
Related papers
- Activations as Features: Probing LLMs for Generalizable Essay Scoring RepresentationsJinwei Chi, Ke Wang, Yu Chen, Xuanye Lin et al.AAAI 2026 · 1 citation
- Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance PerspectiveJiong Wang, Shengquan YuEMNLP Findings 2025 · 1 citation
- Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the ArtShengjie Li, Vincent NgACL 2024 · 8 citations
- Mixture of Ordered Scoring Experts for Cross-prompt Essay Trait ScoringPo-Kai Chen, Bo-Wei Tsai, Shao-Kuan Wei, Chien-Yao Wang et al.ACL 2025
- Cross-Prompt Automated Essay Scoring of Multiple Traits: Making Sense of the State of the ArtShengjie Li, Vincent NgACL 2026 · 10 citations
