Synthetic Data Supervised Salient Object Detection
Zhenyu Wu, Lin Wang, Wei Wang, Tengfei Shi, Chenglizhao Chen, Aimin Hao, Shuo Li
Abstract
Although deep salient object detection (SOD) has achieved remarkable progress, deep SOD models are extremely data-hungry, requiring large-scale pixel-wise annotations to deliver such promising results. In this paper, we propose a novel yet effective method for SOD, coined SODGAN, which can generate infinite high-quality image-mask pairs requiring only a few labeled data, and these synthesized pairs can replace the human-labeled DUTS-TR to train any off-the-shelf SOD model. Its contribution is three-fold. 1) Our proposed diffusion embedding network can address the manifold mismatch and is tractable for the latent code generation, better matching with the ImageNet latent space. 2) For the first time, our proposed few-shot saliency mask generator can synthesize infinite accurate image synchronized saliency masks with a few labeled data. 3) Our proposed quality-aware discriminator can select highquality synthesized image-mask pairs from noisy synthetic data pool, improving the quality of synthetic data. For the first time, our SODGAN tackles SOD with synthetic data directly generated from the generative model, which opens up a new research paradigm for SOD. Extensive experimental results show that the saliency model trained on synthetic data can achieve F-measure of the saliency model trained on the DUTS-TR. Moreover, our approach achieves a new SOTA performance in semi/weakly-supervised methods, and even outperforms several fully-supervised SOTA methods. Code is available at https://github.com/wuzhenyubuaa/SODGAN
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ea12949-524f-4bf8-83b0-eb906be9577bCited by top-tier papers7
- DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion ModelsWeijia Wu, Yuzhong Zhao, Mike Zheng Shou, Hong Zhou et al.ICCV 2023 · 198 citations
- DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion ModelsWeijia Wu, Yuzhong Zhao, Hao Chen, Yuchao Gu et al.NeurIPS 2023 · 191 citations
- Object Segmentation by Mining Cross-Modal SemanticsZongwei Wu, Jingjing Wang, Zhuyun Zhou, Zhaochong An et al.ACM MM 2023 · 40 citations
- Diffusion-based Synthetic Data Generation for Visible-Infrared Person Re-IdentificationWenbo Dai, Lijing Lu, Zhihang LiAAAI 2025 · 14 citations
- S3OD: Towards Generalizable Salient Object Detection with Synthetic DataOrest Kupyn, Hirokatsu Kataoka, Christian RupprechtICLR 2026 · 6 citations
Builds on29
- CoAtNet: Marrying Convolution and Attention for All Data SizesZihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing TanNeurIPS 2021 · 1,747 citations
- GANalyze: Toward Visual Definitions of Cognitive Image PropertiesLore Goetschalckx, Alex Andonian, Aude Oliva, Phillip IsolaICCV 2019 · 345 citations
- Meta-Sim: Learning to Generate Synthetic DatasetsAmlan Kar, Aayush Prakash, Ming-Yu Liu, Eric Cameracci et al.ICCV 2019 · 272 citations
- Pyramidal Feature Shrinking for Salient Object DetectionMingcan Ma, Changqun Xia, Jia LiAAAI 2021 · 180 citations
- Structure-Consistent Weakly Supervised Salient Object Detection with Local Saliency CoherenceSiyue Yu, Bingfeng Zhang, Jimin Xiao, Eng Gee LimAAAI 2021 · 162 citations
Related papers
- Unsupervised Domain Adaptive Salient Object Detection through Uncertainty-Aware Pseudo-Label LearningPengxiang Yan, Ziyi Wu, Mengmeng Liu, Kun Zeng et al.AAAI 2022 · 42 citations
- Weakly-Supervised Salient Object Detection Using Point SupervisonShuyong Gao, Wei Zhang, Yan Wang, Qianyu Guo et al.AAAI 2022 · 77 citations
- Mask-Embedded Discriminator With Region-Based Semantic Regularization for Semi-Supervised Class-Conditional Image SynthesisYi Liu, Xiaoyang Huo, Tianyi Chen, Xiangping Zeng et al.CVPR 2021
- Domain Gap Embeddings for Generative Dataset AugmentationYinong Oliver Wang, Younjoon Chung, Chen Henry Wu, Fernando De la TorreCVPR 2024 · 8 citations
- Weakly-Supervised Salient Object Detection via Scribble AnnotationsJing Zhang, Xin Yu, Aixuan Li, Peipei Song et al.CVPR 2020
