ACL Findings2026
One LLM Does Not Simulate All Students: Ability-Aware Student Simulation via Cognitive Diagnosis Guided LLM Assignment
Huixing Que, Qi Liu, Weibo Gao, Zhenya Huang
Abstract
Large Language Models (LLMs) have become integral to personalized education systems, particularly in the realm of student behavior simulation. By predicting fine-grained learning behaviors, these simulations enable intelligent systems to provide tailored instructional support. However, most existing methods rely on a single high-capacity LLM to represent an entire population of diverse learners. In this work, we demonstrate that this "onesize-fits-all" approach induces a systematic ability-dependent bias, where high-capacity models tend to overestimate low-ability students while lower-capacity models underestimate high-ability ones. To mitigate this distortion, we propose an ability-aware student simulation framework that dynamically matches students with appropriate LLM backbones through cognitive alignment. We leverage Neural Cognitive Diagnosis (NeuralCD) to extract multidimensional cognitive profiles for both human students and LLM agents within a shared skill space, subsequently pairing each student with the most cognitively representative model. Extensive experiments demonstrate that our approach substantially reduces simulation bias and consistently outperforms single-model baselines across the entire proficiency spectrum. Our findings suggest that faithful behavior simulation necessitates the alignment of model capacity with student ability, establishing cognitive diagnosis as a principled mechanism for model assignment in educational AI.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on16
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
- Hybrid LLM: Cost-Efficient and Quality-Aware Query RoutingDujian Ding, Ankur Mallick, Chi Wang, Robert Sim et al.ICLR 2024 · 282 citations
- RCD: Relation Map Driven Cognitive Diagnosis for Intelligent Education SystemsWeibo Gao, Qi Liu, Zhenya Huang, Yu Yin et al.SIGIR 2021 · 168 citations
- Universal Model Routing for Efficient LLM InferenceWittawat Jitkrittum, Harikrishna Narasimhan, Ankit Singh Rawat, Jeevesh Juneja et al.ICLR 2026 · 99 citations
- LLM Agents for Education: Advances and ApplicationsZhendong Chu, Shen Wang, Jian Xie, Tinghui Zhu et al.EMNLP Findings 2025 · 89 citations
Related papers
- Knowledge Is Power: Harnessing Large Language Models for Enhanced Cognitive DiagnosisZhiang Dong, Jingyuan Chen, Fei WuAAAI 2025 · 15 citations
- Improving Interpretability of Cognitive Diagnosis Models with LLM-based Semantic AugmentationYouheng Bai, Jiaqi Zheng, Mingliang Hou, Teng Guo et al.SIGIR 2026
- Personality-aware Student Simulation for Conversational Intelligent Tutoring SystemsZhengyuan Liu, Stella Xin Yin, Geyu Lin, Nancy F. ChenEMNLP 2024 · 13 citations
- CogBench: Benchmarking Cognitive Alignment of Large Language Models in Educational Question AnsweringTong Lu, Zhichun Wang, Yuanhao Sun, Yaoyu Zhou et al.ACL Findings 2026
- Neural Cognitive Diagnosis for Intelligent Education SystemsFei Wang, Qi Liu, Enhong Chen, Zhenya Huang et al.AAAI 2020 · 329 citations
