Incremental Object Detection via Future-Aware Decoupled Cross-Head Distillation
Chenfeng Yin, De Cheng, Wenlong Luo, Mingyue Zeng, Shizhou Zhang, Nannan Wang, Xinbo Gao
Abstract
Incremental Object Detection (IOD) enables AI systems to continuously acquire new object classes while preserving knowledge of previously learned ones, an ability essential for deployment in dynamic, real-world environments. Existing IOD methods typically rely on knowledge distillation to mitigate catastrophic forgetting. However, the tight coupling between the student model's detection head and backbone causes distillation gradients to conflict with newclass supervision at the head, injecting head-specific bias into the backbone and ultimately weakening distillation effectiveness. To address this issue, we propose a decoupled training mechanism for the model's backbone and classification head. Specifically, we introduce the Future-aware Cross-head decoupled Distillation (FaCHD) method, which utilizes two frozen complementary teachers (historical and intermediate teachers) to decode the student's ROI features for cross-head distillation. This strategy implicitly alleviates prediction conflicts caused by detection-head bias and provides richer task-relevant guidance, thereby improving distillation efficiency. To further address the detection head bias and model recency problem, we propose a Prototype Semantic Drift Compensation module, which recalibrates multi-granularity prototypes of old classes, effectively correcting semantic drift and enhancing the stability of the detection head. Extensive experiments on two standard IOD benchmarks demonstrate the effectiveness and superiority of the proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5ebace89-0f53-4100-add8-e302bab7ff99Builds on16
- OW-DETR: Open-world Detection TransformerAkshita Gupta, Sanath Narayan, K. J. Joseph, Salman Khan et al.CVPR 2022 · 209 citations
- Overcoming Catastrophic Forgetting in Graph Neural NetworksHuihui Liu, Yiding Yang, Xinchao WangAAAI 2021 · 166 citations
- Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response DistillationTao Feng, Mang Wang, Hangjie YuanCVPR 2022 · 101 citations
- CrossKD: Cross-Head Knowledge Distillation for Object DetectionJiabao Wang, Yuming Chen, Zhaohui Zheng, Xiang Li et al.CVPR 2024 · 93 citations
- Augmented Box Replay: Overcoming Foreground Shift for Incremental Object DetectionYuyang Liu, Yang Cong, Dipam Goswami, Xialei Liu et al.ICCV 2023 · 52 citations
Related papers
- Interference-Isolated Elastic Weight Consolidation and Knowledge Calibration for Incremental Object DetectionDe Cheng, Mingyue Zeng, Zhipeng Xu, Di Xu et al.ICLR 2026
- Symbiosis-Inspired Knowledge Distillation for Incremental Object DetectionMingyue Zeng, De Cheng, Zhipeng Xu, Huaijie Wang et al.ICML 2026
- DCA: Dividing and Conquering Amnesia in Incremental Object DetectionAoting Zhang, Dongbao Yang, Chang Liu, Xiaopeng Hong et al.AAAI 2025 · 4 citations
- Gradient Decomposition and Alignment for Incremental Object DetectionWenlong Luo, Shizhou Zhang, De Cheng, Yinghui Xing et al.ICCV 2025 · 5 citations
- YOLO-IOD: Towards Real Time Incremental Object DetectionShizhou Zhang, Xueqiang Lv, Yinghui Xing, Qirui Wu et al.AAAI 2026 · 1 citation
