Feature Stylization and Domain-aware Contrastive Learning for Domain Generalization
Seogkyu Jeon, Kibeom Hong, Pilhyeon Lee, Jewook Lee, Hyeran Byun
Abstract
Domain generalization aims to enhance the model robustness against domain shift without accessing the target domain. Since the available source domains for training are limited, recent approaches focus on generating samples of novel domains. Nevertheless, they either struggle with the optimization problem when synthesizing abundant domains or cause the distortion of class semantics. To these ends, we propose a novel domain generalization framework where feature statistics are utilized for stylizing original features to ones with novel domain properties. To preserve class information during stylization, we first decompose features into high and low frequency components. Afterward, we stylize the low frequency components with the novel domain styles sampled from the manipulated statistics, while preserving the shape cues in high frequency ones. As the final step, we re-merge both the components to synthesize novel domain features. To enhance domain robustness, we utilize the stylized features to maintain the model consistency in terms of features as well as outputs. We achieve the feature consistency with the proposed domain-aware supervised contrastive loss, which ensures domain invariance while increasing class discriminability. Experimental results demonstrate the effectiveness of the proposed feature stylization and the domain-aware contrastive loss. Through quantitative comparisons, we verify the lead of our method upon existing state-of-the-art methods on two benchmarks, PACS and Office-Home.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2060b79a-5ff5-4b47-8fd1-b3774b5dcf57Cited by top-tier papers20
- Style Neophile: Constantly Seeking Novel Styles for Domain GeneralizationJuwon Kang, Sohyun Lee, Namyup Kim, Suha KwakCVPR 2022 · 99 citations
- OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution GeneralizationNanyang Ye, Kaican Li, Haoyue Bai, Runpeng Yu et al.CVPR 2022 · 74 citations
- Domain Generalization via Frequency-domain-based Feature Disentanglement and InteractionJingye Wang, Ruoyi Du, Dongliang Chang, Kongming Liang et al.ACM MM 2022 · 66 citations
- Fair Contrastive Learning for Facial Attribute ClassificationSungho Park, Jewook Lee, Pilhyeon Lee, Sunhee Hwang et al.CVPR 2022 · 61 citations
- Label-Efficient Domain Generalization via Collaborative Exploration and GeneralizationJunkun Yuan, Xu Ma, Defang Chen, Kun Kuang et al.ACM MM 2022 · 21 citations
Builds on17
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Domain Generalization with MixStyleKaiyang Zhou, Yongxin Yang, Yu Qiao, Tao XiangICLR 2021 · 986 citations
- Semi-Supervised Domain Adaptation via Minimax EntropyKuniaki Saito, Donghyun Kim, Stan Sclaroff, Trevor Darrell et al.ICCV 2019 · 725 citations
- Episodic Training for Domain GeneralizationDa Li, Jianshu Zhang, Yongxin Yang, Cong Liu et al.ICCV 2019 · 488 citations
Related papers
- Interpolation Normalization for Contrast Domain GeneralizationMengzhu Wang, Junyang Chen, Huan Wang, Huisi Wu et al.ACM MM 2023 · 5 citations
- Domain Generalization via Feature Variation DecorrelationChang Liu, Lichen Wang, Kai Li, Yun FuACM MM 2021 · 21 citations
- Uncertainty Modeling for Out-of-Distribution GeneralizationXiaotong Li, Yongxing Dai, Yixiao Ge, Jun Liu et al.ICLR 2022 · 237 citations
- Adversarial Style Augmentation for Domain Generalized Urban-Scene SegmentationZhun Zhong, Yuyang Zhao, Gim Hee Lee, Nicu SebeNeurIPS 2022 · 130 citations
- Dual-stream Feature Augmentation for Domain GeneralizationShanshan Wang, ALuSi, Xun Yang, Ke Xu et al.ACM MM 2024 · 12 citations
