Lune

ACL Findings2026

One LLM Does Not Simulate All Students: Ability-Aware Student Simulation via Cognitive Diagnosis Guided LLM Assignment

Huixing Que, Qi Liu, Weibo Gao, Zhenya Huang

摘要

Large Language Models (LLMs) have become integral to personalized education systems, particularly in the realm of student behavior simulation. By predicting fine-grained learning behaviors, these simulations enable intelligent systems to provide tailored instructional support. However, most existing methods rely on a single high-capacity LLM to represent an entire population of diverse learners. In this work, we demonstrate that this "onesize-fits-all" approach induces a systematic ability-dependent bias, where high-capacity models tend to overestimate low-ability students while lower-capacity models underestimate high-ability ones. To mitigate this distortion, we propose an ability-aware student simulation framework that dynamically matches students with appropriate LLM backbones through cognitive alignment. We leverage Neural Cognitive Diagnosis (NeuralCD) to extract multidimensional cognitive profiles for both human students and LLM agents within a shared skill space, subsequently pairing each student with the most cognitively representative model. Extensive experiments demonstrate that our approach substantially reduces simulation bias and consistently outperforms single-model baselines across the entire proficiency spectrum. Our findings suggest that faithful behavior simulation necessitates the alignment of model capacity with student ability, establishing cognitive diagnosis as a principled mechanism for model assignment in educational AI.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper16

  1. Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris 等UIST 2023 · 1,882 次引用
  2. Hybrid LLM: Cost-Efficient and Quality-Aware Query RoutingDujian Ding, Ankur Mallick, Chi Wang, Robert Sim 等ICLR 2024 · 282 次引用
  3. RCD: Relation Map Driven Cognitive Diagnosis for Intelligent Education SystemsWeibo Gao, Qi Liu, Zhenya Huang, Yu Yin 等SIGIR 2021 · 168 次引用
  4. Universal Model Routing for Efficient LLM InferenceWittawat Jitkrittum, Harikrishna Narasimhan, Ankit Singh Rawat, Jeevesh Juneja 等ICLR 2026 · 99 次引用
  5. LLM Agents for Education: Advances and ApplicationsZhendong Chu, Shen Wang, Jian Xie, Tinghui Zhu 等EMNLP Findings 2025 · 89 次引用

相关 Paper

  1. Knowledge Is Power: Harnessing Large Language Models for Enhanced Cognitive DiagnosisZhiang Dong, Jingyuan Chen, Fei WuAAAI 2025 · 15 次引用
  2. Improving Interpretability of Cognitive Diagnosis Models with LLM-based Semantic AugmentationYouheng Bai, Jiaqi Zheng, Mingliang Hou, Teng Guo 等SIGIR 2026
  3. Personality-aware Student Simulation for Conversational Intelligent Tutoring SystemsZhengyuan Liu, Stella Xin Yin, Geyu Lin, Nancy F. ChenEMNLP 2024 · 13 次引用
  4. CogBench: Benchmarking Cognitive Alignment of Large Language Models in Educational Question AnsweringTong Lu, Zhichun Wang, Yuanhao Sun, Yaoyu Zhou 等ACL Findings 2026
  5. Neural Cognitive Diagnosis for Intelligent Education SystemsFei Wang, Qi Liu, Enhong Chen, Zhenya Huang 等AAAI 2020 · 329 次引用
黄昏的海面,两侧是细线勾勒的悬崖