A Multi-Task Mean Teacher for Semi-Supervised Shadow Detection
Zhihao Chen, Lei Zhu, Liang Wan, Song Wang, Wei Feng, Pheng-Ann Heng
Abstract
Existing shadow detection methods suffer from an intrinsic limitation in relying on limited labeled datasets, and they may produce poor results in some complicated situations. To boost the shadow detection performance, this paper presents a multi-task mean teacher model for semisupervised shadow detection by leveraging unlabeled data and exploring the learning of multiple information of shadows simultaneously. To be specific, we first build a multitask baseline model to simultaneously detect shadow regions, shadow edges, and shadow count by leveraging their complementary information and assign this baseline model to the student and teacher network. After that, we encourage the predictions of the three tasks from the student and teacher networks to be consistent for computing a consistency loss on unlabeled data, which is then added to the supervised loss on the labeled data from the predictions of the multi-task baseline model. Experimental results on three widely-used benchmark datasets show that our method consistently outperforms all the compared state-ofthe-art methods, which verifies that the proposed network can effectively leverage additional unlabeled data to boost the shadow detection performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers25
- From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real DataYe Liu, Lei Zhu, Shunda Pei, Huazhu Fu et al.ACM MM 2021 · 197 citations
- Mitigating Intensity Bias in Shadow Detection via Feature Decomposition and ReweightingLei Zhu, Ke Xu, Zhanghan Ke, Rynson W. H. LauICCV 2021 · 81 citations
- Joint Video Summarization and Moment Localization by Cross-Task Sample TransferHao Jiang, Yadong MuCVPR 2022 · 45 citations
- ClimateNeRF: Extreme Weather Synthesis in Neural Radiance FieldYuan Li, Zhi-Hao Lin, David A. Forsyth, Jia-Bin Huang et al.ICCV 2023 · 44 citations
- Single Image Shadow Detection via Complementary MechanismYurui Zhu, Xueyang Fu, Chengzhi Cao, Xi Wang et al.ACM MM 2022 · 37 citations
Builds on1
Related papers
- Interactive Self-Training With Mean Teachers for Semi-Supervised Object DetectionQize Yang, Xihan Wei, Biao Wang, Xian-Sheng Hua et al.CVPR 2021
- Video Shadow Detection via Spatio-Temporal Interpolation Consistency TrainingXiao Lu, Yihong Cao, Sheng Liu, Chengjiang Long et al.CVPR 2022 · 24 citations
- Unbiased Teacher for Semi-Supervised Object DetectionYen-Cheng Liu, Chih-Yao Ma, Zijian He, Chia-Wen Kuo et al.ICLR 2021 · 603 citations
- Semi-supervised Video Shadow Detection via Image-assisted Pseudo-label GenerationZipei Chen, Xiao Lu, Ling Zhang, Chunxia XiaoACM MM 2022 · 9 citations
- Mask-ShadowGAN: Learning to Remove Shadows From Unpaired DataXiaowei Hu, Yitong Jiang, Chi-Wing Fu, Pheng-Ann HengICCV 2019 · 255 citations
