Cognitive Fluctuations Enhanced Attention Network for Knowledge Tracing
Mingliang Hou, Xueyi Li, Teng Guo, Zitao Liu, Mi Tian, Renqiang Luo, Weiqi Luo
Abstract
Knowledge tracing (KT) involves using the historical records of student-learning interactions to anticipate their performance on forthcoming questions. Central to this process is the modeling of human cognition to gain deeper insights into how knowledge is acquired and retained. Human cognition is characterized by two key features: long-term cognitive trends, reflecting the gradual accumulation and stabilization of knowledge over time, and short-term cognitive fluctuations, which arise from transient factors such as forgetting or momentary lapses in attention. Although existing attention-based KT models effectively capture long-term cognitive trends, they often fail to adequately address short-term cognitive fluctuations. These limitations lead to overly smoothed cognitive features and reduced model performance, especially when the test data length exceeds the training data length. To address these problems, we propose FlucKT, a novel short-term cognitive fluctuations enhanced attention network for KT tasks. FlucKT improves the attention mechanism in two ways: First, by using a decomposition-based layer with causal convolution to separate and dynamically reweight long-term and short-term cognitive features. Second, by introducing a kernelized bias attention score penalty to enhance focus on short-term fluctuations, improving length generalization capabilities. Our contributions are validated through extensive experiments on three real-world datasets, demonstrating significant improvements in length generalization and prediction performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d1868075-4f4e-4661-b182-2dfd2512aaf9Cited by top-tier papers2
- KeenKT: Knowledge Mastery-State Disambiguation for Knowledge TracingZhifei Li, Lifan Chen, Jiali Yi, Xiaoju Hou et al.AAAI 2026 · 1 citation
- Noise-Aware Graph-Based Cognitive Diagnostic Framework Through Low-Rank AlignmentGuixian Zhang, Yanmei Zhang, Guan Yuan, Shang Liu et al.AAAI 2026
Builds on10
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- Train Short, Test Long: Attention with Linear Biases Enables Input Length ExtrapolationOfir Press, Noah A. Smith, Mike LewisICLR 2022 · 1,168 citations
- Global Filter Networks for Image ClassificationYongming Rao, Wenliang Zhao, Zheng Zhu, Jiwen Lu et al.NeurIPS 2021 · 798 citations
- Learning Process-consistent Knowledge TracingShuanghong Shen, Qi Liu, Enhong Chen, Zhenya Huang et al.KDD 2021 · 149 citations
Related papers
- HRKT: Hierarchical Recurrent Knowledge Tracing for Efficient Transformer-Based Long-Sequence ModelingJu-Yeong Park, Tae-Gwon Lee, Ji-Hoon BaeKDD 2026
- Enhancing Knowledge Tracing via Adversarial TrainingXiaopeng Guo, Zhijie Huang, Jie Gao, Mingyu Shang et al.ACM MM 2021 · 100 citations
- HD-KT: Advancing Robust Knowledge Tracing via Anomalous Learning Interaction DetectionHaiping Ma, Yong Yang, Chuan Qin, Xiaoshan Yu et al.WWW 2024 · 32 citations
- Structured Inductive Bias for Multi-timescale Knowledge TracingXinjia Ou, Tao Huang, Shengze Hu, Huali Yang et al.KDD 2026
- A Frequency-Aware Mixture of Heterogeneous Experts Framework for Knowledge TracingYouheng Bai, Mingliang Hou, Teng Guo, Zitao Liu et al.WWW 2026
