Weakly-Supervised Salient Object Detection Using Point Supervison
Shuyong Gao, Wei Zhang, Yan Wang, Qianyu Guo, Chenglong Zhang, Yangji He, Wenqiang Zhang
Abstract
Current state-of-the-art saliency detection models rely heavily on large datasets of accurate pixel-wise annotations, but manually labeling pixels is time-consuming and labor-intensive. There are some weakly supervised methods developed for alleviating the problem, such as image label, bounding box label, and scribble label, while point label still has not been explored in this field. In this paper, we propose a novel weakly-supervised salient object detection method using point supervision. To infer the saliency map, we first design an adaptive masked flood filling algorithm to generate pseudo labels. Then we develop a transformer-based point-supervised saliency detection model to produce the first round of saliency maps. However, due to the sparseness of the label, the weakly supervised model tends to degenerate into a general foreground detection model. To address this issue, we propose a Non-Salient Suppression (NSS) method to optimize the erroneous saliency maps generated in the first round and leverage them for the second round of training. Moreover, we build a new point-supervised dataset (P-DUTS) by relabeling the DUTS dataset. In P-DUTS, there is only one labeled point for each salient object. Comprehensive experiments on five largest benchmark datasets demonstrate our method outperforms the previous state-of-the-art methods trained with the stronger supervision and even surpass several fully supervised state-of-the-art models. The code is available at: https://github.com/shuyonggao/PSOD.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 61b9c7ee-b1d4-49e1-95fe-3389237e1651Cited by top-tier papers6
- Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature GroupingChunming He, Kai Li, Yachao Zhang, Guoxia Xu et al.NeurIPS 2023 · 205 citations
- Weakly-Supervised Camouflaged Object Detection with Scribble AnnotationsRuozhen He, Qihua Dong, Jiaying Lin, Rynson W. H. LauAAAI 2023 · 126 citations
- Referring Image Segmentation Using Text SupervisionFang Liu, Yuhao Liu, Yuqiu Kong, Ke Xu et al.ICCV 2023 · 52 citations
- Weakly Supervised Video Salient Object Detection via Point SupervisionShuyong Gao, Haozhe Xing, Wei Zhang, Yan Wang et al.ACM MM 2022 · 39 citations
- ZOOM: Learning Video Mirror Detection with Extremely-Weak SupervisionKe Xu, Tsun Wai Siu, Rynson W. H. LauAAAI 2024 · 10 citations
Builds on4
- Structure-Consistent Weakly Supervised Salient Object Detection with Local Saliency CoherenceSiyue Yu, Bingfeng Zhang, Jimin Xiao, Eng Gee LimAAAI 2021 · 162 citations
- MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object DetectionYongri Piao, Jian Wang, Miao Zhang, Huchuan LuICCV 2021 · 64 citations
- Weakly-Supervised Salient Object Detection via Scribble AnnotationsJing Zhang, Xin Yu, Aixuan Li, Peipei Song et al.CVPR 2020
- Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With TransformersSixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu et al.CVPR 2021
Related papers
- Weakly Supervised Video Salient Object DetectionWangbo Zhao, Jing Zhang, Long Li, Nick Barnes et al.CVPR 2021
- Railroad Is Not a Train: Saliency As Pseudo-Pixel Supervision for Weakly Supervised Semantic SegmentationSeungho Lee, Minhyun Lee, Jongwuk Lee, Hyunjung ShimCVPR 2021
- A Simple Vision Transformer for Weakly Semi-supervised 3D Object DetectionDingyuan Zhang, Dingkang Liang, Zhikang Zou, Jingyu Li et al.ICCV 2023 · 36 citations
- Unsupervised Domain Adaptive Salient Object Detection through Uncertainty-Aware Pseudo-Label LearningPengxiang Yan, Ziyi Wu, Mengmeng Liu, Kun Zeng et al.AAAI 2022 · 42 citations
- Synthetic Data Supervised Salient Object DetectionZhenyu Wu, Lin Wang, Wei Wang, Tengfei Shi et al.ACM MM 2022 · 29 citations
