DiL: Discrete-anchored Representation Alignment for Semi-Supervised Continual Learning
Nanyi Wang, Chaojie Chen, Zuoqi Tang, Jinxiang Lai, Xingcai Wu, Qi Wang
Abstract
Leveraging the unlabeled stream is crucial yet challenging in Semi-Supervised Continual Learning (SSCL) under continual class expansion. Existing SSCL methods typically enforce dense pseudo-label consistency and indiscriminate distillation on unlabeled data, which can reinforce errors and intensify base–novel interference. To address these issues, we propose Discrete-anchored Incremental Learning (DiL) to ground continual updates on reliable discrete anchors that remain stable under noisy pseudo-labels. DiL introduces Discrete Contrastive Distillation (DCD), which discretizes the distillation pathway and performs anchor-referenced selective distillation to curb error reinforcement. Meanwhile, Class-Aware Channel-Chunked Encoding (CACE) learns channel-chunked representations and exploits the confusion matrix induced by the discrete anchors to separate novel from confusable base classes. Extensive experiments on multiple datasets show that DiL achieves state-of-the-art performance across diverse SSCL protocols.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e9b0aa79-028c-4c45-83ef-9b0033859a99Builds on10
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo LabelingBowen Zhang, Yidong Wang, Wenxin Hou, Hao Wu et al.NeurIPS 2021 · 1,389 citations
- FreeMatch: Self-adaptive Thresholding for Semi-supervised LearningYidong Wang, Hao Chen, Qiang Heng, Wenxin Hou et al.ICLR 2023 · 139 citations
- DDGR: Continual Learning with Deep Diffusion-based Generative ReplayRui Gao, Weiwei LiuICML 2023 · 101 citations
- A soft nearest-neighbor framework for continual semi-supervised learningZhiqi Kang, Enrico Fini, Moin Nabi, Elisa Ricci et al.ICCV 2023 · 25 citations
Related papers
- Dynamic Sub-graph Distillation for Robust Semi-supervised Continual LearningYan Fan, Yu Wang, Pengfei Zhu, Qinghua HuAAAI 2024 · 14 citations
- Divide-And-Conquer for Enhancing Unlabeled Learning, Stability, and Plasticity in Semi-Supervised Continual LearningYue Duan, Taicai Chen, Lei Qi, Yinghuan ShiICCV 2025 · 2 citations
- ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-Supervised Continual LearningLiyuan Wang, Kuo Yang, Chongxuan Li, Lanqing Hong et al.CVPR 2021
- Persistence Homology Distillation for Semi-supervised Continual LearningYan Fan, Yu Wang, Pengfei Zhu, Dongyue Chen et al.NeurIPS 2024 · 12 citations
- Instance and Category Supervision are Alternate Learners for Continual LearningXudong Tian, Zhizhong Zhang, Xin Tan, Jun Liu et al.ICCV 2023 · 4 citations
