Symbiosis-Inspired Knowledge Distillation for Incremental Object Detection
Mingyue Zeng, De Cheng, Zhipeng Xu, Huaijie Wang, Nannan Wang, Xinbo Gao
Abstract
Incremental object detection (IOD) aims to extend detectors to new categories while retaining previously acquired knowledge. Existing methods often adopt a class incremental learning perspective, separating feature spaces to sharpen decision boundaries. However, this separation-oriented paradigm may overlook object symbiosis in detection, where co-occurrence and occlusion introduce spatial and semantic dependencies that benefit from shared representations. Ignoring these dependencies distorts the shared representations, exacerbates confusion between old and new classes, and accelerates catastrophic forgetting. To address this, we propose Symbiosis-Inspired Knowledge Distillation (SIKD), which explicitly leverages object symbiosis at two complementary levels. Spatial Symbiosis Distillation (SpSD) focuses on symbiotic regions where the old model responds with high overlap to objects in the new task. It preserves generalizable old class cues, suppresses class-specific bias and redundancy, and distills the refined evidence to the new model at matched spatial locations with slot-aligned supervision. Semantic Symbiosis Distillation (SeSD) maintains class level structure by forming confidence weighted prototypes for old classes and aligning their inter class soft ranks over the old class logits, which stabilizes the semantic topology during adaptation. Extensive experiments demonstrate the effectiveness and superiority of the proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ec91fc82-fc3d-4ea1-94d2-e64dcbd24562Builds on17
- FCOS: Fully Convolutional One-Stage Object DetectionZhi Tian, Chunhua Shen, Hao Chen, Tong HeICCV 2019 · 6,042 citations
- Continual Learning with Node-Importance based Adaptive Group Sparse RegularizationSangwon Jung, Hongjoon Ahn, Sungmin Cha, Taesup MoonNeurIPS 2020 · 176 citations
- Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response DistillationTao Feng, Mang Wang, Hangjie YuanCVPR 2022 · 101 citations
- Augmented Box Replay: Overcoming Foreground Shift for Incremental Object DetectionYuyang Liu, Yang Cong, Dipam Goswami, Xialei Liu et al.ICCV 2023 · 52 citations
- Alleviating Catastrophic Forgetting of Incremental Object Detection via Within-Class and Between-Class Knowledge DistillationMengxue Kang, Jinpeng Zhang, Jinming Zhang, Xiashuang Wang et al.ICCV 2023 · 23 citations
Related papers
- Incremental Object Detection via Future-Aware Decoupled Cross-Head DistillationChenfeng Yin, De Cheng, Wenlong Luo, Mingyue Zeng et al.CVPR 2026
- High-dimension Prototype is a Better Incremental Object Detection LearnerYanjie Wang, Liqun Chen, Tianming Zhao, Tao Zhang et al.ICLR 2025
- GCD: Advancing Vision-Language Models for Incremental Object Detection via Global Alignment and Correspondence DistillationXu Wang, Zilei Wang, Zihan LinAAAI 2025 · 4 citations
- Interference-Isolated Elastic Weight Consolidation and Knowledge Calibration for Incremental Object DetectionDe Cheng, Mingyue Zeng, Zhipeng Xu, Di Xu et al.ICLR 2026
- Class-Incremental Instance Segmentation via Multi-Teacher NetworksYanan Gu, Cheng Deng, Kun WeiAAAI 2021 · 32 citations
