ACL Findings2026
PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback
Wei Xia, Jin Wu, Haoran Shi, Xiangyu Wang, Chanjin Zheng
摘要
Effective Automated Essay Scoring (AES) are expected to support both reliable assessment and actionable instructional feedback. However, existing approaches often treat scoring and feedback as separate components: neural scoring models provide limited interpretability, while Large Language Model (LLM)-based feedback is typically insensitive to learners proficiency levels. To address this fragmentation, this work proposes PsyScore, a psychometrically-aware framework that integrates diagnostic assessment with instructional scaffolding through a shared latent ability representation. PsyScore comprises three key modules: a Trait-Adaptive Neural IRT Scorer that incorporates the Graded Partial Credit Model (GPCM) into a neural architecture, enabling the precise estimation of student ability while maintaining psychometric interpretability, a ZPD-Scaffolded Feedback Generator, which conditions multi-agent feedback strategies on the diagnosed ability parameter to adapt instructional focus across different proficiency levels, and a Multi-Perspective Feedback Evaluation Strategy that assesses feedback quality via pairwise preference judgements and student revision simulations. Experiments on the ASAP++ dataset demonstrate that PsyScore achieves competitive scoring performance while providing more pedagogically aligned feedback.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper5
- Does Writing with Language Models Reduce Content Diversity?Vishakh Padmakumar, He HeICLR 2024 · 173 次引用
- Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple RewardsHeejin Do, Sangwon Ryu, Gary Geunbae LeeEMNLP 2024 · 5 次引用
- Closing the Loop: Learning to Generate Writing Feedback via Language Model Simulated Student RevisionsInderjeet Nair, Jiaye Tan, Xiaotian Su, Anne Gere 等EMNLP 2024 · 2 次引用
- CEAES: Bidirectional Reinforcement Learning Optimization for Consistent and Explainable Essay AssessmentXia Li, Wenjing PanACL 2025 · 1 次引用
- SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty PredictionAlexander Scarlatos, Nigel Fernandez, Christopher Ormerod, Susan Lottridge 等EMNLP 2025
相关 Paper
- FeedEval: Pedagogically Aligned Evaluation of LLM-Generated Essay FeedbackSeongYeub Chu, Jongwoo Kim, Mun Yong YiACL Findings 2026 · 1 次引用
- Mixture of Ordered Scoring Experts for Cross-prompt Essay Trait ScoringPo-Kai Chen, Bo-Wei Tsai, Shao-Kuan Wei, Chien-Yao Wang 等ACL 2025
- Automated Cross-prompt Scoring of Essay TraitsRobert Ridley, Liang He, Xin-Yu Dai, Shujian Huang 等AAAI 2021 · 101 次引用
- Unleashing Large Language Models' Proficiency in Zero-shot Essay ScoringSanwoo Lee, Yida Cai, Desong Meng, Ziyang Wang 等EMNLP Findings 2024 · 41 次引用
- Activations as Features: Probing LLMs for Generalizable Essay Scoring RepresentationsJinwei Chi, Ke Wang, Yu Chen, Xuanye Lin 等AAAI 2026 · 1 次引用
