Annealing-based Label-Transfer Learning for Open World Object Detection
Yuqing Ma, Hainan Li, Zhange Zhang, Jinyang Guo, Shanghang Zhang, Ruihao Gong, Xianglong Liu
Abstract
Open world object detection (OWOD) has attracted extensive attention due to its practicability in the real world. Previous OWOD works manually designed unknowndiscover strategies to select unknown proposals from the background, suffering from uncertainties without appropriate priors. In this paper, we claim the learning of object detection could be seen as an object-level featureentanglement process, where unknown traits are propagated to the known proposals through convolutional operations and could be distilled to benefit unknown recognition without manual selection. Therefore, we propose a simple yet effective Annealing-based Label-Transfer framework, which sufficiently explores the known proposals to alleviate the uncertainties. Specifically, a Label-Transfer Learning paradigm is introduced to decouple the known and unknown features, while a Sawtooth Annealing Scheduling strategy is further employed to rebuild the decision boundaries of the known and unknown classes, thus promoting both known and unknown recognition. Moreover, previous OWOD works neglected the trade-off of known and unknown performance, and we thus introduce a metric called Equilibrium Index to comprehensively evaluate the effectiveness of the OWOD models. To the best of our knowledge, this is the first OWOD work without manual unknown selection. Extensive experiments conducted on the common-used benchmark validate that our model achieves superior detection performance (200% unknown mAP improvement with the even higher known detection performance) compared to other state-of-the-art methods. Our code is available at https://github.com/DIG-Beihang/ALLOW.git.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Scene-adaptive and Region-aware Multi-modal Prompt for Open Vocabulary Object DetectionXiaowei Zhao, Xianglong Liu, Duorui Wang, Yajun Gao et al.CVPR 2024 · 8 citations
- Looking Beyond the Known: Towards a Data Discovery Guided Open-World Object DetectionAnay Majee, Amitesh Gangrade, Rishabh IyerNeurIPS 2025 · 5 citations
- Detecting Unknown Objects via Energy-based Separation for Open World Object DetectionJun-Woo Heo, Keonhee Park, Gyeong-Moon ParkCVPR 2026 · 2 citations
- Detecting Open World Objects via Partial Attribute AssignmentMuli Yang, Gabriel James Goenawan, Huaiyuan Qin, Kai Han et al.CVPR 2025
- OW-VAP: Visual Attribute Parsing for Open World Object DetectionXing Xi, Xing Fu, Weiqiang Wang, Ronghua LuoICML 2025
Builds on13
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Deformable DETR: Deformable Transformers for End-to-End Object DetectionXizhou Zhu, Weijie Su, Lewei Lu, Bin Li et al.ICLR 2021 · 7,353 citations
- You Only Look at One Sequence: Rethinking Transformer in Vision through Object DetectionYuxin Fang, Bencheng Liao, Xinggang Wang, Jiemin Fang et al.NeurIPS 2021 · 430 citations
- Expanding Low-Density Latent Regions for Open-Set Object DetectionJiaming Han, Yuqiang Ren, Jian Ding, Xingjia Pan et al.CVPR 2022 · 84 citations
- Channel Pruning Guided by Classification Loss and Feature ImportanceJinyang Guo, Wanli Ouyang, Dong XuAAAI 2020 · 59 citations
Related papers
- PROB: Probabilistic Objectness for Open World Object DetectionOrr Zohar, Kuan-Chieh Wang, Serena YeungCVPR 2023
- OW-DETR: Open-world Detection TransformerAkshita Gupta, Sanath Narayan, K. J. Joseph, Salman Khan et al.CVPR 2022 · 209 citations
- UMB: Understanding Model Behavior for Open-World Object DetectionXing Xi, Yangyang Huang, Zhijie Zhong, Ronghua LuoNeurIPS 2024 · 10 citations
- CAT: LoCalization and IdentificAtion Cascade Detection Transformer for Open-World Object DetectionShuailei Ma, Yuefeng Wang, Ying Wei, Jiaqi Fan et al.CVPR 2023
- UN-DETR: Promoting Objectness Learning via Joint Supervision for Unknown Object DetectionHaomiao Liu, Hao Xu, Chuhuai Yue, Bo MaAAAI 2025 · 1 citation
