Lune

ACL Findings2026

PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback

Wei Xia, Jin Wu, Haoran Shi, Xiangyu Wang, Chanjin Zheng

Abstract

Effective Automated Essay Scoring (AES) are expected to support both reliable assessment and actionable instructional feedback. However, existing approaches often treat scoring and feedback as separate components: neural scoring models provide limited interpretability, while Large Language Model (LLM)-based feedback is typically insensitive to learners proficiency levels. To address this fragmentation, this work proposes PsyScore, a psychometrically-aware framework that integrates diagnostic assessment with instructional scaffolding through a shared latent ability representation. PsyScore comprises three key modules: a Trait-Adaptive Neural IRT Scorer that incorporates the Graded Partial Credit Model (GPCM) into a neural architecture, enabling the precise estimation of student ability while maintaining psychometric interpretability, a ZPD-Scaffolded Feedback Generator, which conditions multi-agent feedback strategies on the diagnosed ability parameter to adapt instructional focus across different proficiency levels, and a Multi-Perspective Feedback Evaluation Strategy that assesses feedback quality via pairwise preference judgements and student revision simulations. Experiments on the ASAP++ dataset demonstrate that PsyScore achieves competitive scoring performance while providing more pedagogically aligned feedback.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on5

  1. Does Writing with Language Models Reduce Content Diversity?Vishakh Padmakumar, He HeICLR 2024 · 173 citations
  2. Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple RewardsHeejin Do, Sangwon Ryu, Gary Geunbae LeeEMNLP 2024 · 5 citations
  3. Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student RevisionsInderjeet Nair, Jiaye Tan, Xiaotian Su, Anne Gere et al.EMNLP 2024 · 2 citations
  4. CEAES: Bidirectional Reinforcement Learning Optimization for Consistent and Explainable Essay AssessmentXia Li, Wenjing PanACL 2025 · 1 citation
  5. SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty PredictionAlexander Scarlatos, Nigel Fernandez, Christopher Ormerod, Susan Lottridge et al.EMNLP 2025

Related papers

  1. FeedEval: Pedagogically Aligned Evaluation of LLM-Generated Essay FeedbackSeongYeub Chu, Jongwoo Kim, Mun Yong YiACL Findings 2026 · 1 citation
  2. Mixture of Ordered Scoring Experts for Cross-prompt Essay Trait ScoringPo-Kai Chen, Bo-Wei Tsai, Shao-Kuan Wei, Chien-Yao Wang et al.ACL 2025
  3. Automated Cross-prompt Scoring of Essay TraitsRobert Ridley, Liang He, Xin-Yu Dai, Shujian Huang et al.AAAI 2021 · 101 citations
  4. Unleashing Large Language Models' Proficiency in Zero-shot Essay ScoringSanwoo Lee, Yida Cai, Desong Meng, Ziyang Wang et al.EMNLP Findings 2024 · 41 citations
  5. Activations as Features: Probing LLMs for Generalizable Essay Scoring RepresentationsJinwei Chi, Ke Wang, Yu Chen, Xuanye Lin et al.AAAI 2026 · 1 citation
Dusk over the sea between two cliffs drawn in fine vertical lines