Contrastive Mean Teacher for Domain Adaptive Object Detectors
Shengcao Cao, Dhiraj Joshi, Liang-Yan Gui, Yu-Xiong Wang
Abstract
Object detectors often suffer from the domain gap between training (source domain) and real-world applications (target domain). Mean-teacher self-training is a powerful paradigm in unsupervised domain adaptation for object detection, but it struggles with low-quality pseudo-labels. In this work, we identify the intriguing alignment and synergy between mean-teacher self-training and contrastive learning. Motivated by this, we propose Contrastive Mean Teacher (CMT) -a unified, general-purpose framework with the two paradigms naturally integrated to maximize beneficial learning signals. Instead of using pseudo-labels solely for final predictions, our strategy extracts objectlevel features using pseudo-labels and optimizes them via contrastive learning, without requiring labels in the target domain. When combined with recent mean-teacher selftraining methods, CMT leads to new state-of-the-art targetdomain performance: 51.9% mAP on Foggy Cityscapes, outperforming the previously best by 2.1% mAP. Notably, CMT can stabilize performance and provide more significant gains as pseudo-label noise increases.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eed70e0c-99da-4cc4-8e4e-2421f178edb3Cited by top-tier papers23
- DetKDS: Knowledge Distillation Search for Object DetectorsLujun Li, Yufan Bao, Peijie Dong, Chuanguang Yang et al.ICML 2024 · 35 citations
- M3-UDA: A New Benchmark for Unsupervised Domain Adaptive Fetal Cardiac Structure DetectionBin Pu, Liwen Wang, Jiewen Yang, Guannan He et al.CVPR 2024 · 21 citations
- DSD-DA: Distillation-based Source Debiasing for Domain Adaptive Object DetectionYongchao Feng, Shiwei Li, Yingjie Gao, Ziyue Huang et al.ICML 2024 · 11 citations
- Diffusion Domain Teacher: Diffusion Guided Domain Adaptive Object DetectorBoyong He, Yuxiang Ji, Zhuoyue Tan, Liaoni WuACM MM 2024 · 10 citations
- Unsupervised Domain Adaptation for Anatomical Structure Detection in Ultrasound ImagesBin Pu, Xingguo Lv, Jiewen Yang, Guannan He et al.ICML 2024 · 10 citations
Builds on19
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Random Erasing Data AugmentationZhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li et al.AAAI 2020 · 4,134 citations
Related papers
- CMT: Co-training Mean-Teacher for Unsupervised Domain Adaptation on 3D Object DetectionShijie Chen, Junbao Zhuo, Xin Li, Haizhuang Liu et al.ACM MM 2024 · 5 citations
- Cross-Domain Adaptive Teacher for Object DetectionYu-Jhe Li, Xiaoliang Dai, Chih-Yao Ma, Yen-Cheng Liu et al.CVPR 2022 · 215 citations
- Periodically Exchange Teacher-Student for Source-Free Object DetectionQipeng Liu, Luojun Lin, Zhifeng Shen, Zhifeng YangICCV 2023 · 50 citations
- Unbiased Mean Teacher for Cross-Domain Object DetectionJinhong Deng, Wen Li, Yuhua Chen, Lixin DuanCVPR 2021
- Mean Teacher DETR with Masked Feature Alignment: A Robust Domain Adaptive Detection Transformer FrameworkWeixi Weng, Chun YuanAAAI 2024 · 31 citations
