Annotation Ambiguity Aware Semi-Supervised Medical Image Segmentation
Suruchi Kumari, Pravendra Singh
Abstract
Despite the remarkable progress of deep learning-based methods in medical image segmentation, their use in clinical practice remains limited for two main reasons. First, obtaining a large medical dataset with precise annotations to train segmentation models is challenging. Secondly, most current segmentation techniques generate a single deterministic segmentation mask for each image. However, in real-world scenarios, there is often significant uncertainty regarding what defines the "correct" segmentation, and various expert annotators might provide different segmentations for the same image. To tackle both of these problems, we propose Annotation Ambiguity Aware Semi-Supervised Medical Image Segmentation (AmbiSSL). Am-biSSL combines a small amount of multi-annotator labeled data and a large set of unlabeled data to generate diverse and plausible segmentation maps. Our method consists of three key components: (1) The Diverse Pseudo-Label Generation (DPG) module utilizes multiple decoders, created by performing randomized pruning on the original backbone decoder. These pruned decoders enable the generation of a diverse pseudo-label set; (2) a Semi-Supervised Latent Distribution Learning (SSLDL) module constructs a common latent space by utilizing both ground truth annotations and pseudo-label set; and (3) a Cross-Decoder Supervision (CDS) module, which enables pruned decoders to guide each other's learning. We evaluated the proposed method on two publicly available datasets. Extensive experiments demonstrate that AmbiSSL can generate diverse segmentation maps using only a small amount of labeled data and abundant unlabeled data, offering a more practical solution for medical image segmentation by reducing reliance on large labeled datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on9
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Stochastic Segmentation with Conditional Categorical Diffusion ModelsLukas Zbinden, Lars Doorenbos, Theodoros Pissas, Adrian Thomas Huber et al.ICCV 2023 · 57 citations
- Probabilistic Modeling of Inter- and Intra-observer Variability in Medical Image SegmentationArne Schmidt, Pablo Morales-Álvarez, Rafael MolinaICCV 2023 · 27 citations
- Diversified and Personalized Multi-Rater Medical Image SegmentationYicheng Wu, Xiangde Luo, Zhe Xu, Xiaoqing Guo et al.CVPR 2024
- Ambiguous Medical Image Segmentation Using Diffusion ModelsAimon Rahman, Jeya Maria Jose Valanarasu, Ilker Hacihaliloglu, Vishal M. PatelCVPR 2023
Related papers
- A Probabilistic Model for Controlling Diversity and Accuracy of Ambiguous Medical Image SegmentationWei Zhang, Xiaohong Zhang, Sheng Huang, Yuting Lu et al.ACM MM 2022 · 13 citations
- P2SAM: Probabilistically Prompted SAMs Are Efficient Segmentator for Ambiguous Medical ImagesYuzhi Huang, Chenxin Li, Zixu Lin, Hengyu Liu et al.ACM MM 2024 · 15 citations
- Bidirectional Copy-Paste for Semi-Supervised Medical Image SegmentationYunhao Bai, Duowen Chen, Qingli Li, Wei Shen et al.CVPR 2023
- A Semantic Knowledge Complementarity based Decoupling Framework for Semi-supervised Class-imbalanced Medical Image SegmentationZheng Zhang, Guanchun Yin, Bo Zhang, Wu Liu et al.CVPR 2025
- SemiGDA: Generative Dual-distribution Alignment for Semi-Supervised Medical Image Segmentationkaiwen Huang, Yi Zhou, Yizhe Zhang, Jingxiong Li et al.CVPR 2026
