Integrating Deep Metric Learning with Coreset for Active Learning in 3D Segmentation
Arvind Murari Vepa, Zukang Yang, Andrew Choi, Jungseock Joo, Fabien Scalzo, Yizhou Sun
Abstract
Deep learning has seen remarkable advancements in machine learning, yet it often demands extensive annotated data. Tasks like 3D semantic segmentation impose a substantial annotation burden, especially in domains like medicine, where expert annotations drive up the cost. Active learning (AL) holds great potential to alleviate this annotation burden in 3D medical segmentation. The majority of existing AL methods, however, are not tailored to the medical domain. While weakly-supervised methods have been explored to reduce annotation burden, the fusion of AL with weak supervision remains unexplored, despite its potential to significantly reduce annotation costs. Additionally, there is little focus on slice-based AL for 3D segmentation, which can also significantly reduce costs in comparison to conventional volume-based AL. This paper introduces a novel metric learning method for Coreset to perform slice-based active learning in 3D medical segmentation. By merging contrastive learning with inherent data groupings in medical imaging, we learn a metric that emphasizes the relevant differences in samples for training 3D medical segmentation models. We perform comprehensive evaluations using both weak and full annotations across four datasets (medical and non-medical). Our findings demonstrate that our approach surpasses existing active learning techniques on both weak and full annotations and obtains superior performance with low-annotation budgets which is crucial in medical imaging. Source code for this project is available in the supplementary materials and on GitHub: https://github.com/arvindmvepa/al-seg.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2bedafd0-2001-4146-8762-75fdb50af72eCited by top-tier papers5
- WeatherPrompt: Multi-modality Representation Learning for All-Weather Drone Visual Geo-LocalizationJiahao Wen, Hang Yu, Zhedong ZhengNeurIPS 2025 · 11 citations
- Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image SegmentationSzymon Plotka, Gizem Mert, Maciej Chrabaszcz, Ewa Szczurek et al.NeurIPS 2025 · 5 citations
- Toward Fair and Accurate Cross-Domain Medical Image Segmentation: a Vlm-Driven Active Domain Adaptation ParadigmHongqiu Wang, Wu Chen, Xiangde Luo, Zhaohu Xing et al.ICCV 2025 · 3 citations
- Similarity-as-Evidence: Calibrating Overconfident VLMs for Interpretable and Label-Efficient Medical Active LearningZhuofan Xie, Zishan Lin, Jinliang Lin, Jie Qi et al.CVPR 2026 · 1 citation
- Advancing Complex Wide-Area Scene Understanding with Hierarchical Coresets SelectionJingyao Wang, Yiming Chen, Lingyu Si, Changwen ZhengACM MM 2025
Builds on27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 9,451 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Contrastive learning of global and local features for medical image segmentation with limited annotationsKrishna Chaitanya, Ertunc Erdil, Neerav Karani, Ender KonukogluNeurIPS 2020 · 714 citations
Related papers
- Self-Paced Contrastive Learning for Semi-supervised Medical Image Segmentation with Meta-labelsJizong Peng, Ping Wang, Christian Desrosiers, Marco PedersoliNeurIPS 2021 · 80 citations
- GCL: Gradient-Guided Contrastive Learning for Medical Image Segmentation with Multi-Perspective Meta LabelsYixuan Wu, Jintai Chen, Jiahuan Yan, Yiheng Zhu et al.ACM MM 2023 · 9 citations
- Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image AnalysisYankai Jiang, Mingze Sun, Heng Guo, Xiaoyu Bai et al.ICCV 2023 · 38 citations
- SGTC: Semantic-Guided Triplet Co-training for Sparsely Annotated Semi-Supervised Medical Image SegmentationKe Yan, Qing Cai, Fan Zhang, Ziyan Cao et al.AAAI 2025 · 1 citation
- Simple but Effective: Sub-Volume Contrastive Learning for Class-Imbalanced Semi-Supervised 3D Medical Image SegmentationXianrun Xu, Baoyao Yang, Wanyun Li, Jingsong Lin et al.ACM MM 2025 · 1 citation
