Time Series Class-Incremental Learning via Confidence-guided Mask Distillation and Prototype-guided Contrastive Learning
Yu Liu, Haoqin Yang, Jinping Sui, Hui Wang, Haipeng Li, Weimin Wang, Qi Jia
Abstract
Class-incremental learning (CIL) has recently gained great attention in the field of time series classification. Existing CIL methods based on knowledge distillation exhibit impressive ability to retain prior knowledge and overcome catastrophic forgetting, however, their effectiveness faces major challenges posed by time series data. Since temporal data is more susceptible to sensor errors and electronic noise, the distillation process may be significantly affected by noisy knowledge transfer. To address this issue, we propose a novel confidence-guided mask distillation (CMD) framework, to prevent the noisy inheritance during distillation. The core of CMD lies in a dynamic masking mechanism guided by prediction confidence, capable of allocating higher weights to high-confidence time series and substantially suppressing the influence of low-confidence ones. Additionally, different from prior work simply passing a set of feature prototypes to the classifier, we develop prototype-guided contrastive learning (PCL) to alleviate the classifier bias on new classes, through extra contrastive constraints to push away the feature distributions of old feature prototypes from those of new classes features. Extensive experiments on three time-series datasets demonstrate that, our method significantly outperforms other replay-free CIL approaches in raising average accuracy, as well as decreasing forgetting rate.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionArthur Douillard, Alexandre Ramé, Guillaume Couairon, Matthieu CordCVPR 2022 · 315 citations
- Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series ClassificationYihe Wang, Nan Huang, Taida Li, Yujun Yan et al.NeurIPS 2024 · 158 citations
- STDEN: Towards Physics-Guided Neural Networks for Traffic Flow PredictionJiahao Ji, Jingyuan Wang, Zhe Jiang, Jiawei Jiang et al.AAAI 2022 · 115 citations
- GCR: Gradient Coreset based Replay Buffer Selection for Continual LearningRishabh Tiwari, KrishnaTeja Killamsetty, Rishabh K. Iyer, Pradeep ShenoyCVPR 2022 · 102 citations
- Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response DistillationTao Feng, Mang Wang, Hangjie YuanCVPR 2022 · 101 citations
Related papers
- Distilling Causal Effect of Data in Class-Incremental LearningXinting Hu, Kaihua Tang, Chunyan Miao, Xian-Sheng Hua et al.CVPR 2021
- Topology-aware Knowledge Preservation for Class-Incremental LearningHan Zang, Yongfeng Dong, Linhao Li, Liang Yang et al.AAAI 2026
- FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental LearningQiwei Li, Yuxin Peng, Jiahuan ZhouCVPR 2024
- Make Domain Shift a Catastrophic Forgetting Alleviator in Class-Incremental LearningWei Chen, Yi ZhouAAAI 2025 · 4 citations
- Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental LearningBingchen Huang, Zhineng Chen, Peng Zhou, Jiayin Chen et al.AAAI 2023 · 31 citations
