Interference-Isolated Elastic Weight Consolidation and Knowledge Calibration for Incremental Object Detection
De Cheng, Mingyue Zeng, Zhipeng Xu, Di Xu, Nannan Wang, Xinbo Gao
Abstract
Incremental Object Detection (IOD) enables AI systems to continuously learn new object classes over time while retaining knowledge of previously learned categories. This capability is essential for adapting to dynamic environments without forgetting prior information. Although existing IOD methods have made progress in mitigating catastrophic forgetting, they usually lack explicit and quantitative modeling of information conflicts during knowledge preservation, making task boundaries ambiguous. Such conflicts often stem from the fact that a single image can contain objects belonging to previous, present, and future tasks, where unlabeled past and future objects are often mistakenly treated as background. In this paper, we propose a novel approach grounded in Elastic Weight Consolidation (EWC) to alleviate conflict knowledge preservation caused by task interference. Specifically, we introduce the Interference Knowledge Isolated Elastic Weight Consolidation (IKI-EWC) framework for IOD, which leverages the mispredictions of the old detector on new task data to estimate task conflicts and suppresses them at the parameter level. By reformulating the Bayesian posterior of model parameters, we derive a mathematical relationship between previously learned knowledge and interference knowledge, enabling targeted elimination of conflicts during model weight updates. In addition, we also propose a prototype-based knowledge calibration (PKC) mechanism to further preserve old knowledge during the training of the objector's classification head. This method employs a learnable projection layer to compensate semantic drift in old class prototypes, and then jointly trains the classification head using both calibrated prototypes and current task features, thereby mitigating forgetting caused by classifier updates. Extensive experiments on PASCAL VOC and MS-COCO benchmarks demonstrate the effectiveness of the proposed method, outperforming state-of-the-art approaches in various settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on23
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- FCOS: Fully Convolutional One-Stage Object DetectionZhi Tian, Chunhua Shen, Hao Chen, Tong HeICCV 2019 · 6,042 citations
- OW-DETR: Open-world Detection TransformerAkshita Gupta, Sanath Narayan, K. J. Joseph, Salman Khan et al.CVPR 2022 · 209 citations
- Always Be Dreaming: A New Approach for Data-Free Class-Incremental LearningJames Seale Smith, Yen-Chang Hsu, Jonathan C. Balloch, Yilin Shen et al.ICCV 2021 · 208 citations
- RMM: Reinforced Memory Management for Class-Incremental LearningYaoyao Liu, Bernt Schiele, Qianru SunNeurIPS 2021 · 125 citations
Related papers
- Incremental Object Detection via Future-Aware Decoupled Cross-Head DistillationChenfeng Yin, De Cheng, Wenlong Luo, Mingyue Zeng et al.CVPR 2026
- Gradient Decomposition and Alignment for Incremental Object DetectionWenlong Luo, Shizhou Zhang, De Cheng, Yinghui Xing et al.ICCV 2025 · 5 citations
- Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response DistillationTao Feng, Mang Wang, Hangjie YuanCVPR 2022 · 101 citations
- High-dimension Prototype is a Better Incremental Object Detection LearnerYanjie Wang, Liqun Chen, Tianming Zhao, Tao Zhang et al.ICLR 2025
- Parameterized Prompt for Incremental Object DetectionZijia An, Boyu Diao, Ruiqi Liu, Libo Huang et al.CVPR 2026 · 1 citation
