Lune

EMNLP Findings2025

Improving Prompt Generalization for Cross-prompt Essay Trait Scoring from the Scoring-invariance Perspective

Jiong Wang, Shengquan Yu

Abstract

Cross-prompt trait scoring task aims to learn generalizable scoring capabilities from sourceprompt data, enabling automatic scoring across multiple dimensions on unseen essays. Existing research on cross-prompt trait essay scoring primarily focuses on improving model generalization by obtaining prompt-invariant representations. In this paper, we approach the research problem from a different perspective on invariance learning and propose a scoring-invariant learning objective. This objective encourages the model to focus on intrinsic information within the essay that reflects its quality during training, thereby learning generic scoring features. To further enhance the model's ability to score across multiple dimensions, we introduce a trait feature extraction network based on routing gates into the scoring architecture and propose a trait consistency scoring objective to encourage the model to balance the diversity of trait-specific features with scoring consistency across traits when learning trait-specific essay features. Extensive experiments demonstrate the effectiveness of our approach, showing advantages in multi-trait scoring performance and achieving significant improvements with lowresource prompts.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on9

  1. Automated Cross-prompt Scoring of Essay TraitsRobert Ridley, Liang He, Xin-Yu Dai, Shujian Huang et al.AAAI 2021 · 101 citations
  2. When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical ApplicationsQidong Liu, Xian Wu, Xiangyu Zhao, Yuanshao Zhu et al.SIGIR 2024 · 89 citations
  3. Unleashing Large Language Models' Proficiency in Zero-shot Essay ScoringSanwoo Lee, Yida Cai, Desong Meng, Ziyang Wang et al.EMNLP Findings 2024 · 41 citations
  4. Time-Series Forecasting for Out-of-Distribution Generalization Using Invariant LearningHaoxin Liu, Harshavardhan Kamarthi, Lingkai Kong, Zhiyuan Zhao et al.ICML 2024 · 32 citations
  5. Prompt- and Trait Relation-aware Cross-prompt Essay Trait ScoringHeejin Do, Yunsu Kim, Gary Geunbae LeeACL Findings 2023 · 29 citations

Related papers

  1. TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay ScoringSohaila Eltanbouly, Salam Albatarni, Tamer ElsayedACL Findings 2025 · 7 citations
  2. Multi-knowledge Enhanced Graph Neural Network for Multi-trait Essay ScoringShiman Zhao, Siyuan Liu, Zhiqi ShenAAAI 2026
  3. Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the ArtShengjie Li, Vincent NgACL 2024 · 8 citations
  4. Activations as Features: Probing LLMs for Generalizable Essay Scoring RepresentationsJinwei Chi, Ke Wang, Yu Chen, Xuanye Lin et al.AAAI 2026 · 1 citation
  5. Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation LearningZhiwei Jiang, Tianyi Gao, Yafeng Yin, Meng Liu et al.ACL 2023 · 16 citations
Dusk over the sea between two cliffs drawn in fine vertical lines