ConstStyle: Robust Domain Generalization with Unified Style Transformation
Nam Duong Tran, Nam Nguyen Phuong, Hieu H. Pham, Phi Le Nguyen, My T. Thai
Abstract
Deep neural networks often suffer performance drops when test data distribution differs from training data. Domain Generalization (DG) aims to address this by focusing on domain-invariant features or augmenting data for greater diversity. However, these methods often struggle with limited training domains or significant gaps between seen (training) and unseen (test) domains. To enhance DG robustness, we hypothesize that it is essential for the model to be trained on data from domains that closely resemble unseen test domains-an inherently difficult task due to the absence of prior knowledge about the unseen domains. Accordingly, we propose ConstStyle, a novel approach that leverages a unified domain to capture domain-invariant features and bridge the domain gap with theoretical analysis. During training, all samples are mapped onto this unified domain, optimized for seen domains. During testing, unseen domain samples are projected similarly before predictions. By aligning both training and testing data within this unified domain, ConstStyle effectively reduces the impact of domain shifts, even with large domain gaps or few seen domains. Extensive experiments demonstrate that Const-Style consistently outperforms existing methods across diverse scenarios. Notably, when only a limited number of seen domains are available, ConstStyle can boost accuracy up to 19.82% compared to the next best approach. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 290742d2-c470-4bd6-a809-2cd83d473c6bBuilds on10
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Domain Generalization with MixStyleKaiyang Zhou, Yongxin Yang, Yu Qiao, Tao XiangICLR 2021 · 986 citations
- Efficient Domain Generalization via Common-Specific Low-Rank DecompositionVihari Piratla, Praneeth Netrapalli, Sunita SarawagiICML 2020 · 250 citations
- Uncertainty Modeling for Out-of-Distribution GeneralizationXiaotong Li, Yongxing Dai, Yixiao Ge, Jun Liu et al.ICLR 2022 · 237 citations
- Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain GeneralizationYabin Zhang, Minghan Li, Ruihuang Li, Kui Jia et al.CVPR 2022 · 217 citations
Related papers
- DomainDrop: Suppressing Domain-Sensitive Channels for Domain GeneralizationJintao Guo, Lei Qi, Yinghuan ShiICCV 2023 · 47 citations
- Test-Time Style Shifting: Handling Arbitrary Styles in Domain GeneralizationJungwuk Park, Dong-Jun Han, Soyeong Kim, Jaekyun MoonICML 2023 · 16 citations
- Towards Robust Object Detection Invariant to Real-World Domain ShiftsQi Fan, Mattia Segù, Yu-Wing Tai, Fisher Yu et al.ICLR 2023
- Domain Generalization Using a Mixture of Multiple Latent DomainsToshihiko Matsuura, Tatsuya HaradaAAAI 2020 · 355 citations
- Reducing Domain Gap by Reducing Style BiasHyeonseob Nam, HyunJae Lee, Jongchan Park, Wonjun Yoon et al.CVPR 2021
