Pseudo-Label Guided Contrastive Learning for Semi-Supervised Medical Image Segmentation
Hritam Basak, Zhaozheng Yin
Abstract
Although recent works in semi-supervised learning (SemiSL) have accomplished significant success in natural image segmentation, the task of learning discriminative representations from limited annotations has been an open problem in medical images. Contrastive Learning (CL) frameworks use the notion of similarity measure which is useful for classification problems, however, they fail to transfer these quality representations for accurate pixel-level segmentation. To this end, we propose a novel semi-supervised patch-based CL framework for medical image segmentation without using any explicit pretext task. We harness the power of both CL and SemiSL, where the pseudo-labels generated from SemiSL aid CL by providing additional guidance, whereas discriminative class information learned in CL leads to accurate multi-class segmentation. Additionally, we formulate a novel loss that synergistically encourages inter-class separability and intraclass compactness among the learned representations. A new inter-patch semantic disparity mapping using average patch entropy is employed for a guided sampling of positives and negatives in the proposed CL framework. Experimental analysis on three publicly available datasets of multiple modalities reveals the superiority of our proposed method as compared to the state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers16
- Contextual Augmented Global Contrast for Multimodal Intent RecognitionKaili Sun, Zhiwen Xie, Mang Ye, Huyin ZhangCVPR 2024 · 19 citations
- RankMatch: A Novel Approach to Semi-Supervised Label Distribution Learning Leveraging Rank Correlation between LabelsZhiqiang Kou, Yucheng Xie, Hailin Wang, Junyang Chen et al.NeurIPS 2025 · 18 citations
- MATCH: Multi-faceted Adaptive Topo-Consistency for Semi-Supervised Histopathology SegmentationMeilong Xu, Xiaoling Hu, Shahira Abousamra, Chen Li et al.NeurIPS 2025 · 5 citations
- Neighbor Does Matter: Density-Aware Contrastive Learning for Medical Semi-supervised SegmentationFeilong Tang, Zhongxing Xu, Ming Hu, Wenxue Li et al.AAAI 2025 · 3 citations
- Uncertainty-Informed Meta Pseudo Labeling for Surrogate Modeling with Limited Labeled DataXingyu Ren, Pengwei Liu, Pengkai Wang, Guanyu Chen et al.NeurIPS 2025 · 2 citations
Builds on17
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Big Self-Supervised Models are Strong Semi-Supervised LearnersTing Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi et al.NeurIPS 2020 · 2,611 citations
- Semi-supervised Medical Image Segmentation through Dual-task ConsistencyXiangde Luo, Jieneng Chen, Tao Song, Guotai WangAAAI 2021 · 754 citations
Related papers
- Cross-patch Dense Contrastive Learning for Semi-supervised Segmentation of Cellular Nuclei in Histopathologic ImagesHuisi Wu, Zhaoze Wang, Youyi Song, Lin Yang et al.CVPR 2022 · 82 citations
- STiL: Semi-supervised Tabular-Image Learning for Comprehensive Task-Relevant Information Exploration in Multimodal ClassificationSiyi Du, Xinzhe Luo, Declan P. O'Regan, Chen QinCVPR 2025
- Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image SegmentationHuimin Huang, Yawen Huang, Shiao Xie, Lanfen Lin et al.AAAI 2024 · 17 citations
- Anatomical Prior Guided Spatial Contrastive Learning for Few-Shot Medical Image SegmentationWendong Huang, Jinwu Hu, Xiuli Bi, Bin XiaoACM MM 2024 · 13 citations
- Looking Beyond Single Images for Contrastive Semantic Segmentation LearningFeihu Zhang, Philip H. S. Torr, René Ranftl, Stephan R. RichterNeurIPS 2021 · 44 citations
