Divide-And-Conquer for Enhancing Unlabeled Learning, Stability, and Plasticity in Semi-Supervised Continual Learning
Yue Duan, Taicai Chen, Lei Qi, Yinghuan Shi
Abstract
Semi-supervised continual learning (SSCL) seeks to leverage both labeled and unlabeled data in a sequential learning setup, aiming to reduce annotation costs while managing continual data arrival. SSCL introduces complex challenges, including ensuring effective unlabeled learning (UL), while balancing memory stability (MS) and learning plasticity (LP). Previous SSCL efforts have typically focused on isolated aspects of the three, while this work presents USP, a divide-and-conquer framework designed to synergistically enhance these three aspects: (1) Feature Space Reservation (FSR) strategy for LP, which constructs reserved feature locations for future classes by shaping old classes into an equiangular tight frame; (2) Divide-andConquer Pseudo-labeling (DCP) approach for UL, which assigns reliable pseudo-labels across both high- and lowconfidence unlabeled data; and (3) Class-mean-anchored Unlabeled Distillation (CUD) for MS, which reuses DCP's outputs to anchor unlabeled data to stable class means for distillation to prevent forgetting. Comprehensive evaluations show USP outperforms prior SSCL methods, with gains up to 5.94 % in the last accuracy, validating its effectiveness. The code is available at https://github.com/NJUyued/USP4SSCL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Are Tools Always Beneficial? Learning to Invoke Tools Adaptively for Dual-Mode Multimodal LLM ReasoningQinghe Ma, Zhen Zhao, Yiming Wu, Jian Zhang et al.ICML 2026
- DiL: Discrete-anchored Representation Alignment for Semi-Supervised Continual LearningNanyi Wang, Chaojie Chen, Zuoqi Tang, Jinxiang Lai et al.ICML 2026
Builds on31
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang et al.CVPR 2022 · 635 citations
- Forward Compatible Few-Shot Class-Incremental LearningDa-Wei Zhou, Fu-Yun Wang, Han-Jia Ye, Liang Ma et al.CVPR 2022 · 259 citations
Related papers
- Dynamic Sub-graph Distillation for Robust Semi-supervised Continual LearningYan Fan, Yu Wang, Pengfei Zhu, Qinghua HuAAAI 2024 · 14 citations
- Preparing the Future for Continual Semantic SegmentationZihan Lin, Zilei Wang, Yixin ZhangICCV 2023 · 8 citations
- Preserving Linear Separability in Continual Learning by Backward Feature ProjectionQiao Gu, Dongsub Shim, Florian ShkurtiCVPR 2023
- Flexi-FSCIL: Adaptive Knowledge Retention for Breaking the Stability-Plasticity Dilemma in Few-Shot Class-Incremental LearningWufei Xie, Yalin Wang, Chenliang Liu, Zhaohui Jiang et al.ICCV 2025 · 3 citations
- SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental LearningSungmin Cha, Beomyoung Kim, Youngjoon Yoo, Taesup MoonNeurIPS 2021 · 139 citations
