Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation
Yuanyi Zhong, Bodi Yuan, Hong Wu, Zhiqiang Yuan, Jian Peng, Yu-Xiong Wang
Abstract
We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-space contrastive property among different pixels. We lever-age the pixel-level ℓ2 loss and the pixel contrastive loss for the two purposes respectively. To address the computational efficiency issue and the false negative noise issue involved in the pixel contrastive loss, we further introduce and investigate several negative sampling techniques. Extensive experiments demonstrate the state-of-the-art performance of our method (PC2Seg) with the DeepLab-v3+ architecture, in several challenging semi-supervised settings derived from the VOC, Cityscapes, and COCO datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 104d1c2d-ea64-457b-b4df-808ce3e4a3e3Cited by top-tier papers55
- ST++: Make Self-trainingWork Better for Semi-supervised Semantic SegmentationLihe Yang, Wei Zhuo, Lei Qi, Yinghuan Shi et al.CVPR 2022 · 467 citations
- Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-LabelsYuchao Wang, Haochen Wang, Yujun Shen, Jingjing Fei et al.CVPR 2022 · 448 citations
- Semi-supervised Semantic Segmentation with Prototype-based Consistency RegularizationHaiming Xu, Lingqiao Liu, Qiuchen Bian, Zhen YangNeurIPS 2022 · 122 citations
- Semi-supervised Semantic Segmentation with Error Localization NetworkDonghyeon Kwon, Suha KwakCVPR 2022 · 108 citations
- WildNet: Learning Domain Generalized Semantic Segmentation from the WildSuhyeon Lee, Hongje Seong, Seongwon Lee, Euntai KimCVPR 2022 · 95 citations
Builds on19
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
Related papers
- Semi-Supervised Semantic Segmentation With Directional Context-Aware ConsistencyXin Lai, Zhuotao Tian, Li Jiang, Shu Liu et al.CVPR 2021
- C3-SemiSeg: Contrastive Semi-supervised Segmentation via Cross-set Learning and Dynamic Class-balancingYanning Zhou, Hang Xu, Wei Zhang, Bin Gao et al.ICCV 2021 · 87 citations
- Improving Semi-Supervised Semantic Segmentation with Dual-Level Siamese Structure NetworkZhibo Tian, Xiaolin Zhang, Peng Zhang, Kun ZhanACM MM 2023 · 14 citations
- Contrastive Learning for Label Efficient Semantic SegmentationXiangyun Zhao, Raviteja Vemulapalli, Philip Andrew Mansfield, Boqing Gong et al.ICCV 2021 · 200 citations
- Bootstrapping Semantic Segmentation with Regional ContrastShikun Liu, Shuaifeng Zhi, Edward Johns, Andrew J. DavisonICLR 2022 · 151 citations
