KARL: Knowledge-Aware Retrieval and Representations aid Retention and Learning in Students
Matthew Shu, Nishant Balepur, Shi Feng, Jordan L. Boyd-Graber
Abstract
Flashcard schedulers rely on 1) student models to predict the flashcards a student knows; and 2) teaching policies to pick which cards to show next via these predictions. Prior student models, however, just use study data like the student's past responses, ignoring the text on cards. We propose content-aware scheduling, the first schedulers exploiting flashcard content. To give the first evidence that such schedulers enhance student learning, we build KAR 3 L, a simple but effective content-aware student model employing deep knowledge tracing (DKT), retrieval, and BERT to predict student recall. We train KAR 3 L by collecting a new dataset of 123,143 study logs on diverse trivia questions. KAR 3 L bests existing student models in AUC and calibration error. To ensure our improved predictions lead to better student learning, we create a novel delta-based teaching policy to deploy KAR 3 L online. Based on 32 study paths from 27 users, KAR 3 L improves learning efficiency over SOTA, showing KAR 3 L's strength and encouraging researchers to look beyond historical study data to fully capture student abilities. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers2
- A SMART Mnemonic Sounds like "Glue Tonic": Mixing LLMs with Student Feedback to Make Mnemonic Learning StickNishant Balepur, Matthew Shu, Alexander Miserlis Hoyle, Alison Robey et al.EMNLP 2024 · 2 citations
- Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User PersonasNishant Balepur, Vishakh Padmakumar, Fumeng Yang, Shi Feng et al.ACL 2025
Builds on5
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Transformers Can Do Arithmetic with the Right EmbeddingsSean McLeish, Arpit Bansal, Alex Stein, Neel Jain et al.NeurIPS 2024 · 94 citations
- Adaptive and Personalized Exercise Generation for Online Language LearningPeng Cui, Mrinmaya SachanACL 2023 · 15 citations
- Expository Text Generation: Imitate, Retrieve, ParaphraseNishant Balepur, Jie Huang, Kevin Chen-Chuan ChangEMNLP 2023 · 6 citations
- It's Not Easy Being Wrong: Large Language Models Struggle with Process of Elimination ReasoningNishant Balepur, Shramay Palta, Rachel RudingerACL Findings 2024 · 3 citations
Related papers
- Revisiting Knowledge Tracing: A Simple and Powerful ModelXiaoxuan Shen, Fenghua Yu, Yaqi Liu, Ruxia Liang et al.ACM MM 2024 · 16 citations
- Enhancing the Knowledge Tracing via a Plug-In Guided Diffusion ModelShuaishuai Zu, Jihao Zhao, Biao QinAAAI 2026
- Deep Attentive Model for Knowledge TracingXinping Wang, Liangyu Chen, Min ZhangAAAI 2023 · 10 citations
- Knowledge Tracing in Programming Education Integrating Students' QuestionsDoyoun Kim, Suin Kim, Yohan JoACL 2025
- Question Difficulty Consistent Knowledge TracingGuimei Liu, Huijing Zhan, Jung-Jae KimWWW 2024 · 23 citations
