A Closed-Form Solution for Fast and Reliable Adaptive Testing
Yan Zhuang, Chenye Ke, Zirui Liu, Qi Liu, Yuting Ning, Zhenya Huang, Weizhe Huang, Qingyang Mao, Shijin Wang
Abstract
Human ability estimation is essential for educational assessment, career advancement, and professional certification. Adaptive Testing systems can improve estimation efficiency by selecting fewer, targeted questions, and are widely used in exams, e.g., GRE, GMAT, and Duolingo English Test. However, selecting an optimal subset of questions remains a challenging nested optimization problem. Existing methods rely on costly approximations or data-intensive training, making them unsuitable for today's large-scale and complex testing environments. Thus, we propose a Closed-Form solution for question subset selection in Adaptive Testing. It directly minimizes ability estimation error by reducing ability parameter's gradient bias while maintaining Hessian stability, which enables a simple greedy algorithm for question selection. Moreover, it can quantify the impact of human behavioral perturbations on ability estimation. Extensive experiments on large-scale educational datasets demonstrate that it reduces the number of required questions by 10% compared to SOTA methods, while maintaining the same estimation accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on15
- Coresets for Data-efficient Training of Machine Learning ModelsBaharan Mirzasoleiman, Jeff A. Bilmes, Jure LeskovecICML 2020 · 494 citations
- Neural Cognitive Diagnosis for Intelligent Education SystemsFei Wang, Qi Liu, Enhong Chen, Zhenya Huang et al.AAAI 2020 · 329 citations
- Fully Adaptive Framework: Neural Computerized Adaptive Testing for Online EducationYan Zhuang, Qi Liu, Zhenya Huang, Zhi Li et al.AAAI 2022 · 66 citations
- Active Learning Helps Pretrained Models Learn the Intended TaskAlex Tamkin, Dat Nguyen, Salil Deshpande, Jesse Mu et al.NeurIPS 2022 · 54 citations
- Neural Active Learning with Performance GuaranteesZhilei Wang, Pranjal Awasthi, Christoph Dann, Ayush Sekhari et al.NeurIPS 2021 · 26 citations
Related papers
- A Bounded Ability Estimation for Computerized Adaptive TestingYan Zhuang, Qi Liu, Guanhao Zhao, Zhenya Huang et al.NeurIPS 2023 · 15 citations
- A Unified Adaptive Testing System Enabled by Hierarchical Structure SearchJunhao Yu, Yan Zhuang, Zhenya Huang, Qi Liu et al.ICML 2024 · 12 citations
- A Robust Computerized Adaptive Testing Approach in Educational Question RetrievalYan Zhuang, Qi Liu, Zhenya Huang, Zhi Li et al.SIGIR 2022 · 17 citations
- Explicit and Implicit Examinee-Question Relation Exploiting for Efficient Computerized Adaptive TestingChangqian Wang, Shangshang Yang, Siyu Song, Ziwen Wang et al.AAAI 2025 · 2 citations
- Beyond Item Selection: Rethinking Ability Evolution in Computerized Adaptive TestingXiaoshan Yu, Jian Li, Shangshang Yang, Ziwen Wang et al.KDD 2026
