Dual-Consistency Model Inversion for Non-Exemplar Class Incremental Learning
Zihuan Qiu, Yi Xu, Fanman Meng, Hongliang Li, Linfeng Xu, Qingbo Wu
Abstract
Non-exemplar class incremental learning (NECIL) aims to continuously assimilate new knowledge without forgetting previously acquired ones when historical data are un-available. One of the generative NECIL methods is to in-vert the images of old classes for joint training. However, these synthetic images suffer significant domain shifts compared with real data, hampering the recognition of old classes. In this paper, we present a novel method termed Dual-Consistency Model Inversion (DCMI) to generate better synthetic samples of old classes through two pivotal consistency alignments: (1) the semantic consistency between the synthetic images and the corresponding prototypes, and (2) domain consistency between synthetic and real images of new classes. Besides, we introduce Prototypical Routing (PR) to provide task-prior information and generate unbi-ased and accurate predictions. Our comprehensive experiments across diverse datasets consistently showcase the superiority of our method over previous state-of-the-art approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f6f8e35d-2476-4fa1-9cfb-8e8e7b906e22Cited by top-tier papers7
- MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model MergingZihuan Qiu, Yi Xu, Chiyuan He, Fanman Meng et al.NeurIPS 2025 · 16 citations
- Model Inversion with Layer-Specific Modeling and Alignment for Data-Free Continual LearningRuilin Tong, Haodong Lu, Yuhang Liu, Dong GongNeurIPS 2025 · 6 citations
- Null-Space Filtering for Data-Free Continual Model Merging: Preserving Stability, Promoting PlasticityZihuan Qiu, Lei Wang, Yang Cao, Runtong ZHANG et al.ICLR 2026 · 4 citations
- Confusion-Driven Self-Supervised Progressively Weighted Ensemble Learning for Non-Exemplar Class Incremental LearningKai Hu, Yu Zhang, Yuan Zhang, Zhineng Chen et al.NeurIPS 2025 · 1 citation
- Merge to Remember: Sharpness-Aware Isotropic Merging for Continual LearningQun Yang, Enneng Yang, Wei Chen, Li Shen et al.ICML 2026
Builds on20
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Improved Knowledge Distillation via Teacher AssistantSeyed-Iman Mirzadeh, Mehrdad Farajtabar, Ang Li, Nir Levine et al.AAAI 2020 · 1,361 citations
- Domain Generalization with MixStyleKaiyang Zhou, Yongxin Yang, Yu Qiao, Tao XiangICLR 2021 · 986 citations
- On the Efficacy of Knowledge DistillationJang Hyun Cho, Bharath HariharanICCV 2019 · 741 citations
- A Comprehensive Overhaul of Feature DistillationByeongho Heo, Jeesoo Kim, Sangdoo Yun, Hyojin Park et al.ICCV 2019 · 727 citations
Related papers
- Prototype Reminiscence and Augmented Asymmetric Knowledge Aggregation for Non-Exemplar Class-Incremental LearningWuxuan Shi, Mang YeICCV 2023 · 49 citations
- Prospective Representation Learning for Non-Exemplar Class-Incremental LearningWuxuan Shi, Mang YeNeurIPS 2024 · 9 citations
- FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental LearningQiwei Li, Yuxin Peng, Jiahuan ZhouCVPR 2024
- Dynamic Integration of Task-Specific Adapters for Class Incremental LearningJiashuo Li, Shaokun Wang, Bo Qian, Yuhang He et al.CVPR 2025
- Non-Exemplar Class-Incremental Learning via Adaptive Old Class ReconstructionShaokun Wang, Weiwei Shi, Yuhang He, Yifan Yu et al.ACM MM 2023 · 12 citations
