DiL: Discrete-anchored Representation Alignment for Semi-Supervised Continual Learning
Nanyi Wang, Chaojie Chen, Zuoqi Tang, Jinxiang Lai, Xingcai Wu, Qi Wang
摘要
Leveraging the unlabeled stream is crucial yet challenging in Semi-Supervised Continual Learning (SSCL) under continual class expansion. Existing SSCL methods typically enforce dense pseudo-label consistency and indiscriminate distillation on unlabeled data, which can reinforce errors and intensify base–novel interference. To address these issues, we propose Discrete-anchored Incremental Learning (DiL) to ground continual updates on reliable discrete anchors that remain stable under noisy pseudo-labels. DiL introduces Discrete Contrastive Distillation (DCD), which discretizes the distillation pathway and performs anchor-referenced selective distillation to curb error reinforcement. Meanwhile, Class-Aware Channel-Chunked Encoding (CACE) learns channel-chunked representations and exploits the confusion matrix induced by the discrete anchors to separate novel from confusable base classes. Extensive experiments on multiple datasets show that DiL achieves state-of-the-art performance across diverse SSCL protocols.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong 等NeurIPS 2020 · 被引用 2,774 次
- FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo LabelingBowen Zhang, Yidong Wang, Wenxin Hou, Hao Wu 等NeurIPS 2021 · 被引用 1,389 次
- FreeMatch: Self-adaptive Thresholding for Semi-supervised LearningYidong Wang, Hao Chen, Qiang Heng, Wenxin Hou 等ICLR 2023 · 被引用 139 次
- DDGR: Continual Learning with Deep Diffusion-based Generative ReplayRui Gao, Weiwei LiuICML 2023 · 被引用 101 次
- A soft nearest-neighbor framework for continual semi-supervised learningZhiqi Kang, Enrico Fini, Moin Nabi, Elisa Ricci 等ICCV 2023 · 被引用 25 次
相关 Paper
- Dynamic Sub-graph Distillation for Robust Semi-supervised Continual LearningYan Fan, Yu Wang, Pengfei Zhu, Qinghua HuAAAI 2024 · 被引用 14 次
- Divide-And-Conquer for Enhancing Unlabeled Learning, Stability, and Plasticity in Semi-Supervised Continual LearningYue Duan, Taicai Chen, Lei Qi, Yinghuan ShiICCV 2025 · 被引用 2 次
- ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-Supervised Continual LearningLiyuan Wang, Kuo Yang, Chongxuan Li, Lanqing Hong 等CVPR 2021
- Persistence Homology Distillation for Semi-supervised Continual LearningYan Fan, Yu Wang, Pengfei Zhu, Dongyue Chen 等NeurIPS 2024 · 被引用 12 次
- Instance and Category Supervision are Alternate Learners for Continual LearningXudong Tian, Zhizhong Zhang, Xin Tan, Jun Liu 等ICCV 2023 · 被引用 4 次
