EMNLP Findings2025
Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance Perspective
Jiong Wang, Shengquan Yu
摘要
Cross-prompt trait scoring task aims to learn generalizable scoring capabilities from sourceprompt data, enabling automatic scoring across multiple dimensions on unseen essays. Existing research on cross-prompt trait essay scoring primarily focuses on improving model generalization by obtaining prompt-invariant representations. In this paper, we approach the research problem from a different perspective on invariance learning and propose a scoring-invariant learning objective. This objective encourages the model to focus on intrinsic information within the essay that reflects its quality during training, thereby learning generic scoring features. To further enhance the model's ability to score across multiple dimensions, we introduce a trait feature extraction network based on routing gates into the scoring architecture and propose a trait consistency scoring objective to encourage the model to balance the diversity of trait-specific features with scoring consistency across traits when learning trait-specific essay features. Extensive experiments demonstrate the effectiveness of our approach, showing advantages in multi-trait scoring performance and achieving significant improvements with lowresource prompts.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper9
- Automated Cross-prompt Scoring of Essay TraitsRobert Ridley, Liang He, Xin-Yu Dai, Shujian Huang 等AAAI 2021 · 101 次引用
- When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical ApplicationsQidong Liu, Xian Wu, Xiangyu Zhao, Yuanshao Zhu 等SIGIR 2024 · 89 次引用
- Unleashing Large Language Models' Proficiency in Zero-shot Essay ScoringSanwoo Lee, Yida Cai, Desong Meng, Ziyang Wang 等EMNLP Findings 2024 · 41 次引用
- Time-Series Forecasting for Out-of-Distribution Generalization Using Invariant LearningHaoxin Liu, Harshavardhan Kamarthi, Lingkai Kong, Zhiyuan Zhao 等ICML 2024 · 32 次引用
- Prompt- and Trait Relation-aware Cross-prompt Essay Trait ScoringHeejin Do, Yunsu Kim, Gary Geunbae LeeACL Findings 2023 · 29 次引用
相关 Paper
- TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay ScoringSohaila Eltanbouly, Salam Albatarni, Tamer ElsayedACL Findings 2025 · 7 次引用
- Multi-knowledge Enhanced Graph Neural Network for Multi-trait Essay ScoringShiman Zhao, Siyuan Liu, Zhiqi ShenAAAI 2026
- Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the ArtShengjie Li, Vincent NgACL 2024 · 8 次引用
- Activations as Features: Probing LLMs for Generalizable Essay Scoring RepresentationsJinwei Chi, Ke Wang, Yu Chen, Xuanye Lin 等AAAI 2026 · 1 次引用
- Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation LearningZhiwei Jiang, Tianyi Gao, Yafeng Yin, Meng Liu 等ACL 2023 · 16 次引用
