Split-And-Combine: Enhancing Style Augmentation for Single Domain Generalization
Zhen Zhang, Shuai Yang, Qianlong Dang, Zhize Wu, Lichuan Gu
Abstract
Single domain generalization aims to learn a model with good generalization ability from a single source domain. Recent advances in this field have focused on increasing the diversity of the training data through style (e.g., color and texture) augmentation. However, most existing methods apply uniform perturbations to the entire image, failing to simulate complex images with multiple distinct stylistic regions. To address this, we propose a "Split-And-Combine" (SAC) strategy to enhance style diversity. Specifically, SAC first performs patch-aware augmentation, which splits an image into multiple patches and applies style augmentation independently to each patch, enabling distinct color variations across regions. Then, SAC combines these patches to reconstruct a complete image and applies adaptive random convolutions, which utilizes a deformable convolution layer with random and Gaussian filters to enhance texture diversity while preserving object integrity. Notably, SAC leverages entropy as a risk assessment criterion to adaptively determine whether a sample should undergo augmentation within the iterative process of random convolutions, preventing excessive augmentation. Furthermore, SAC introduces an energy-based distribution discrepancy score to quantify out-of-distribution likelihood, systematically expanding the augmented data's distribution. SAC can serve as a plug-and-play component to improve the performance of recent methods. Extensive experiments on four datasets demonstrate the effectiveness of SAC.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a955ebd0-7390-4874-8c7d-cde50cb72553Builds on20
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Energy-based Out-of-distribution DetectionWeitang Liu, Xiaoyun Wang, John D. Owens, Yixuan LiNeurIPS 2020 · 2,213 citations
- Your classifier is secretly an energy based model and you should treat it like oneWill Grathwohl, Kuan-Chieh Wang, Jörn-Henrik Jacobsen, David Duvenaud et al.ICLR 2020 · 643 citations
- Invariance Principle Meets Information Bottleneck for Out-of-Distribution GeneralizationKartik Ahuja, Ethan Caballero, Dinghuai Zhang, Jean-Christophe Gagnon-Audet et al.NeurIPS 2021 · 372 citations
- Learning to Diversify for Single Domain GeneralizationZijian Wang, Yadan Luo, Ruihong Qiu, Zi Huang et al.ICCV 2021 · 339 citations
Related papers
- Progressive Random Convolutions for Single Domain GeneralizationSeokeon Choi, Debasmit Das, Sungha Choi, Seunghan Yang et al.CVPR 2023
- Rethinking Data Augmentation for Single-Source Domain Generalization in Medical Image SegmentationZixian Su, Kai Yao, Xi Yang, Kaizhu Huang et al.AAAI 2023 · 123 citations
- StyDeSty: Min-Max Stylization and Destylization for Single Domain GeneralizationSonghua Liu, Xin Jin, Xingyi Yang, Jingwen Ye et al.ICML 2024 · 9 citations
- Domain-Agnostic Crowd Counting via Uncertainty-Guided Style Diversity AugmentationGuanchen Ding, Lingbo Liu, Zhenzhong Chen, Changwen ChenACM MM 2024 · 7 citations
- Practical Single Domain Generalization via Training-time and Test-time LearningShuai Yang, Zhen Zhang, Lichuan GuKDD 2024 · 3 citations
