FairSeg: A Large-Scale Medical Image Segmentation Dataset for Fairness Learning Using Segment Anything Model with Fair Error-Bound Scaling
Yu Tian, Min Shi, Yan Luo, Ava Kouhana, Tobias Elze, Mengyu Wang
Abstract
Fairness in artificial intelligence models has gained significantly more attention in recent years, especially in the area of medicine, as fairness in medical models is critical to people's well-being and lives. High-quality medical fairness datasets are needed to promote fairness learning research. Existing medical fairness datasets are all for classification tasks, and no fairness datasets are available for medical segmentation, while medical segmentation is an equally important clinical task as classifications, which can provide detailed spatial information on organ abnormalities ready to be assessed by clinicians. In this paper, we propose the first fairness dataset for medical segmentation named Harvard-FairSeg with 10,000 subject samples. In addition, we propose a fair error-bound scaling approach to reweight the loss function with the upper error-bound in each identity group, using the segment anything model (SAM). We anticipate that the segmentation performance equity can be improved by explicitly tackling the hard cases with high training errors in each identity group. To facilitate fair comparisons, we utilize a novel equity-scaled segmentation performance metric to compare segmentation metrics in the context of fairness, such as the equity-scaled Dice coefficient. Through comprehensive experiments, we demonstrate that our fair error-bound scaling approach either has superior or comparable fairness performance to the state-of-the-art fairness learning models. The dataset and code are publicly accessible via https://ophai.hms.harvard.edu/datasets/harvard-fairseg10k.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Autoregressive Sequence Modeling for 3D Medical Image RepresentationSiwen Wang, Churan Wang, Fei Gao, Lixian Su et al.AAAI 2025 · 5 citations
- Toward Fair and Accurate Cross-Domain Medical Image Segmentation: a Vlm-Driven Active Domain Adaptation ParadigmHongqiu Wang, Wu Chen, Xiangde Luo, Zhaohu Xing et al.ICCV 2025 · 3 citations
- The Boundaries of Fair AI in Medical Image Prognosis: A Causal PerspectiveThai-Hoang Pham, Jiayuan Chen, Seungyeon Lee, Yuanlong Wang et al.NeurIPS 2025 · 3 citations
- Distribution-aware Fairness Learning in Medical Image Segmentation From A Control-Theoretic PerspectiveYujin Oh, Pengfei Jin, Sangjoon Park, Sekeun Kim et al.ICML 2025
Builds on7
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- FR-Train: A Mutual Information-Based Approach to Fair and Robust TrainingYuji Roh, Kangwook Lee, Steven Whang, Changho SuhICML 2020 · 90 citations
- Fair Contrastive Learning for Facial Attribute ClassificationSungho Park, Jewook Lee, Pilhyeon Lee, Sunhee Hwang et al.CVPR 2022 · 61 citations
- Fairness-aware Adversarial Perturbation Towards Bias Mitigation for Deployed Deep ModelsZhibo Wang, Xiaowei Dong, Henry Xue, Zhifei Zhang et al.CVPR 2022 · 49 citations
- Harvard Glaucoma Detection and Progression: A Multimodal Multitask Dataset and Generalization-Reinforced Semi-Supervised LearningYan Luo, Min Shi, Yu Tian, Tobias Elze et al.ICCV 2023 · 36 citations
Related papers
- Unleashing the Potential of SAM for Medical Adaptation via Hierarchical DecodingZhiheng Cheng, Qingyue Wei, Hongru Zhu, Yan Wang et al.CVPR 2024
- FairCLIP: Harnessing Fairness in Vision-Language LearningYan Luo, Min Shi, Muhammad Osama Khan, Muhammad Muneeb Afzal et al.CVPR 2024 · 37 citations
- MaskSAM: Auto-Prompt SAM with Mask Classification for Volumetric Medical Image SegmentationBin Xie, Hao Tang, Bin Duan, Dawen Cai et al.ICCV 2025 · 7 citations
- Towards a Comprehensive, Efficient and Promptable Anatomic Structure Segmentation Model Using 3D Whole-Body CT ScansHeng Guo, Jianfeng Zhang, Jiaxing Huang, Tony C. W. Mok et al.AAAI 2025 · 12 citations
- P2SAM: Probabilistically Prompted SAMs Are Efficient Segmentator for Ambiguous Medical ImagesYuzhi Huang, Chenxin Li, Zixu Lin, Hengyu Liu et al.ACM MM 2024 · 15 citations
