Is Depth Really Necessary for Salient Object Detection?
Jiawei Zhao, Yifan Zhao, Jia Li, Xiaowu Chen
Abstract
Salient object detection (SOD) is a crucial and preliminary task for many computer vision applications, which have made progress with deep CNNs. Most of the existing methods mainly rely on the RGB information to distinguish the salient objects, which faces difficulties in some complex scenarios. To solve this, many recent RGBD-based networks are proposed by adopting the depth map as an independent input and fuse the features with RGB information. Taking the advantages of RGB and RGBD methods, we propose a novel depth-aware salient object detection framework, which has following superior designs: 1) It only takes the depth information as training data while only relies on RGB information in the testing phase. 2) It comprehensively optimizes SOD features with multi-level depth-aware regularizations. 3) The depth information also serves as error-weighted map to correct the segmentation process. With these insightful designs combined, we make the first attempt in realizing an unified depth-aware framework with only RGB information as input for inference, which not only surpasses the state-of-the-art performance on five public RGB SOD benchmarks, but also surpasses the RGBDbased methods on five benchmarks by a large margin, while adopting less information and implementation light-weighted. The code and model will be publicly available.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 977e9911-976d-4ace-b6fb-a081183f293eCited by top-tier papers12
- TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding NetworkZhengyi Liu, Yuan Wang, Zhengzheng Tu, Yun Xiao et al.ACM MM 2021 · 175 citations
- RGB-D Saliency Detection via Cascaded Mutual Information MinimizationJing Zhang, Deng-Ping Fan, Yuchao Dai, Xin Yu et al.ICCV 2021 · 122 citations
- Complementary Trilateral Decoder for Fast and Accurate Salient Object DetectionZhirui Zhao, Changqun Xia, Chenxi Xie, Jia LiACM MM 2021 · 119 citations
- Pyramid Grafting Network for One-Stage High Resolution Saliency DetectionChenxi Xie, Changqun Xia, Mingcan Ma, Zhirui Zhao et al.CVPR 2022 · 112 citations
- Source-free Depth for Object Pop-outZongwei Wu, Danda Pani Paudel, Deng-Ping Fan, Jingjing Wang et al.ICCV 2023 · 110 citations
Builds on4
- Enforcing Geometric Constraints of Virtual Normal for Depth PredictionWei Yin, Yifan Liu, Chunhua Shen, Youliang YanICCV 2019 · 487 citations
- Global Context-Aware Progressive Aggregation Network for Salient Object DetectionZuyao Chen, Qianqian Xu, Runmin Cong, Qingming HuangAAAI 2020 · 481 citations
- Depth-Induced Multi-Scale Recurrent Attention Network for Saliency DetectionYongri Piao, Wei Ji, Jingjing Li, Miao Zhang et al.ICCV 2019 · 450 citations
- Selectivity or Invariance: Boundary-Aware Salient Object DetectionJinming Su, Jia Li, Yu Zhang, Changqun Xia et al.ICCV 2019 · 192 citations
Related papers
- Deep RGB-D Saliency Detection With Depth-Sensitive Attention and Automatic Multi-Modal FusionPeng Sun, Wenhu Zhang, Huanyu Wang, Songyuan Li et al.CVPR 2021
- Calibrated RGB-D Salient Object DetectionWei Ji, Jingjing Li, Shuang Yu, Miao Zhang et al.CVPR 2021
- Cross-modality Discrepant Interaction Network for RGB-D Salient Object DetectionChen Zhang, Runmin Cong, Qinwei Lin, Lin Ma et al.ACM MM 2021 · 116 citations
- Specificity-preserving RGB-D Saliency DetectionTao Zhou, Huazhu Fu, Geng Chen, Yi Zhou et al.ICCV 2021 · 210 citations
- JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object DetectionKeren Fu, Deng-Ping Fan, Ge-Peng Ji, Qijun ZhaoCVPR 2020
