Energy-guided Dual Domain-invariant Prompting Framework with Fourier Regularization for Generalized Few-Shot Medical Segmentation
Shaolei Liu, Yuting Wu, Dongchen Zhu, Jiamao Li
Abstract
Precise segmentation of organ and tissue lesions is essential for clinical diagnosis and treatment. Despite the progress of deep learning and foundation segmentation models, their domain generalization capability remains limited particularly when dealing with cross-domain scenarios or unseen data, leading to significant performance degradation. Current medical SAM-based generalization methods face two primary challenges: First, existing prompt-tuning strategies inadequately capture key domain-invariant features; Second, the reliance on fully labeled source domain data is unrealistic in clinical practice. To address these challenges, we propose a novel Dual domain-Invariant Prompt Optimization (DIPO) enhanced by energy-guided augmentation and frequency consistency regularization for few-shot medical image segmentation generalization. Our approach introduces a multi-band momentum enhancement strategy to dynamically augment source data by leveraging diverse frequency bands of the Fourier amplitude spectrum. Furthermore, we integrate multiscale geometric representation-based non-subsampled shearlet transform and text prompts to strengthen the extraction of shape- and texture-related domain-invariant features. Finally, we employ frequency consistency regularization to refine model robustness using predictions from unlabeled data. Experimental results in prostate and fundus datasets demonstrate that our method significantly outperforms current state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- AdaptFormer: Adapting Vision Transformers for Scalable Visual RecognitionShoufa Chen, Chongjian Ge, Zhan Tong, Jiangliu Wang et al.NeurIPS 2022 · 1,291 citations
- Domain Generalization for Medical Imaging Classification with Linear-Dependency RegularizationHaoliang Li, Yufei Wang, Renjie Wan, Shiqi Wang et al.NeurIPS 2020 · 233 citations
- Model-Based Domain GeneralizationAlexander Robey, George J. Pappas, Hamed HassaniNeurIPS 2021 · 167 citations
- Active Learning for Domain Adaptation: An Energy-Based ApproachBinhui Xie, Longhui Yuan, Shuang Li, Chi Harold Liu et al.AAAI 2022 · 149 citations
Related papers
- Focus on Background: Exploring SAM's Potential in Few-shot Medical Image Segmentation with Background-centric PromptingYuntian Bo, Yazhou Zhu, Piotr Koniusz, Haofeng ZhangCVPR 2026 · 1 citation
- Single-Domain Generalization in Medical Image Segmentation via Test-Time Adaptation from Shape DictionaryQuande Liu, Cheng Chen, Qi Dou, Pheng-Ann HengAAAI 2022 · 50 citations
- APSeg: Auto-Prompt Network for Cross-Domain Few-Shot Semantic SegmentationWeizhao He, Yang Zhang, Wei Zhuo, Linlin Shen et al.CVPR 2024
- Universal Frequency Domain Perturbation for Single-Source Domain GeneralizationChuang Liu, Yichao Cao, Xiu Su, Haogang ZhuACM MM 2024 · 8 citations
- FAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image SegmentationYuntian Bo, Yazhou Zhu, Lunbo Li, Haofeng ZhangAAAI 2025 · 11 citations
