Augmentation-invariant Learning Strategy via Data Augmentation for Improving Model Generalization
Yu Miao, Juanjuan Zhao, Sijie Song, Ran Gong, Yuanqian Zhu, Lusha Qi, Yan Qiang
Abstract
Data augmentation is an effective technique for regularizing deep networks, which helps to enhance the generalizability and robustness of the model. However, in the field of medical imaging, traditional data augmentation techniques such as cropping, rotation, and degradation may inadvertently alter the critical characteristics of pathological lesions. Conventional semantic augmentation methods, such as altering the color and contrast of the object background, may also affect the structural features of medical images in uncontrolled semantic directions. Such operational conditions compromise the model's diagnostic reliability in medical contexts. To address this issue, we propose a surprisingly efficient implicit augmentation-invariant learning strategy (AILS) via variational Bayesian inference on differentially constrained feature manifolds. Parameterizing probability measures over tangent space through deep networks enables precise estimation of semantic direction distributions. Subsequently, geodesic-aware semantic features are sampled from the reparameterized variational posterior, achieving semantic-consistent feature augmentation. Simultaneously, to mine augmentation distribution invariance, we design the AiHLoss, which constrains the augmentation distribution to facilitate the network to learn augmentation invariance. Extensive experiments demonstrate that AILS exhibits high performance on public medical image datasets, outperforming existing augmentation methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Random Erasing Data AugmentationZhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li et al.AAAI 2020 · 4,134 citations
- Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded ViewsJunbo Zhang, Kaisheng MaCVPR 2022 · 39 citations
- Adversarial Examples Improve Image RecognitionCihang Xie, Mingxing Tan, Boqing Gong, Jiang Wang et al.CVPR 2020
- Analyzing and Improving the Image Quality of StyleGANTero Karras, Samuli Laine, Miika Aittala, Janne Hellsten et al.CVPR 2020
Related papers
- Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based AugmentationDwarikanath Mahapatra, Behzad Bozorgtabar, Ling ShaoCVPR 2020
- Rethinking Data Augmentation for Single-Source Domain Generalization in Medical Image SegmentationZixian Su, Kai Yao, Xi Yang, Kaizhu Huang et al.AAAI 2023 · 123 citations
- Modeling the Probabilistic Distribution of Unlabeled Data for One-shot Medical Image SegmentationYuhang Ding, Xin Yu, Yi YangAAAI 2021 · 42 citations
- Adversarial Bayesian Augmentation for Single-Source Domain GeneralizationSheng Cheng, Tejas Gokhale, Yezhou YangICCV 2023 · 35 citations
- Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image AnalysisYankai Jiang, Mingze Sun, Heng Guo, Xiaoyu Bai et al.ICCV 2023 · 38 citations
