Occlusion-Shared and Feature-Separated Network for Occlusion Relationship Reasoning
Rui Lu, Feng Xue, Menghan Zhou, Anlong Ming, Yu Zhou
Abstract
Occlusion relationship reasoning demands closed contour to express the object, and orientation of each contour pixel to describe the order relationship between objects. Current CNN-based methods neglect two critical issues of the task: (1) simultaneous existence of the relevance and distinction for the two elements, i.e, occlusion edge and occlusion orientation; and (2) inadequate exploration to the orientation features. For the reasons above, we propose the Occlusion-shared and Feature-separated Network (OFNet). On one hand, considering the relevance between edge and orientation, two sub-networks are designed to share the occlusion cue. On the other hand, the whole network is split into two paths to learn the high-level semantic features separately. Moreover, a contextual feature for orientation prediction is extracted, which represents the bilateral cue of the foreground and background areas. The bilateral cue is then fused with the occlusion cue to precisely locate the object regions. Finally, a stripe convolution is designed to further aggregate features from surrounding scenes of the occlusion edge. The proposed OFNet remarkably advances the state-of-the-art approaches on PIOD and BSDS ownership dataset. The source code is available at https://github.com/buptlr/OFNet .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- RINDNet: Edge Detection for Discontinuity in Reflectance, Illumination, Normal and DepthMengyang Pu, Yaping Huang, Qingji Guan, Haibin LingICCV 2021 · 75 citations
- MT-ORL: Multi-Task Occlusion Relationship LearningPanhe Feng, Qi She, Lei Zhu, Jiaxin Li et al.ICCV 2021 · 11 citations
- Amodal Scene Analysis via Holistic Occlusion Relation Inference and Generative Mask CompletionBowen Zhang, Qing Liu, Jianming Zhang, Yilin Wang et al.AAAI 2024 · 4 citations
- SM4Depth: Seamless Monocular Metric Depth Estimation across Multiple Cameras and Scenes by One ModelYihao Liu, Feng Xue, Anlong Ming, Mingshuai Zhao et al.ACM MM 2024 · 2 citations
- Robust Instance Segmentation Through Reasoning About Multi-Object OcclusionXiaoding Yuan, Adam Kortylewski, Yihong Sun, Alan L. YuilleCVPR 2021
Related papers
- Deep Occlusion-Aware Instance Segmentation With Overlapping BiLayersLei Ke, Yu-Wing Tai, Chi-Keung TangCVPR 2021
- Bidirectional Graph Reasoning Network for Panoptic SegmentationYangxin Wu, Gengwei Zhang, Yiming Gao, Xiajun Deng et al.CVPR 2020
- BANet: Bidirectional Aggregation Network With Occlusion Handling for Panoptic SegmentationYifeng Chen, Guangchen Lin, Songyuan Li, Omar El Farouk Bourahla et al.CVPR 2020
- Full-Duplex Strategy for Video Object SegmentationGe-Peng Ji, Keren Fu, Zhe Wu, Deng-Ping Fan et al.ICCV 2021 · 173 citations
- Learning Occlusion Disentanglement with Fine-grained Localization for Occluded Person Re-identificationWenfeng Liu, Xudong Wang, Lei Tan, Yan Zhang et al.ACM MM 2023 · 9 citations
