Open Domain Generalization with Domain-Augmented Meta-Learning
Yang Shu, Zhangjie Cao, Chenyu Wang, Jianmin Wang, Mingsheng Long
Abstract
Leveraging datasets available to learn a model with high generalization ability to unseen domains is important for computer vision, especially when the unseen domain's annotated data are unavailable. We study a novel and practical problem of Open Domain Generalization (OpenDG), which learns from different source domains to achieve high performance on an unknown target domain, where the distributions and label sets of each individual source domain and the target domain can be different. The problem can be generally applied to diverse source domains and widely applicable to real-world applications. We propose a Domain-Augmented Meta-Learning framework to learn open-domain generalizable representations. We augment domains on both featurelevel by a new Dirichlet mixup and label-level by distilled soft-labeling, which complements each domain with missing classes and other domain knowledge. We conduct metalearning over domains by designing new meta-learning tasks and losses to preserve domain unique knowledge and generalize knowledge across domains simultaneously. Experiment results on various multi-domain datasets demonstrate that the proposed Domain-Augmented Meta-Learning (DAML) outperforms prior methods for unseen domain recognition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 931a1d09-3dde-4a13-bb65-097704d472e9Cited by top-tier papers44
- Improving Out-of-Distribution Robustness via Selective AugmentationHuaxiu Yao, Yu Wang, Sai Li, Linjun Zhang et al.ICML 2022 · 275 citations
- Model-Based Domain GeneralizationAlexander Robey, George J. Pappas, Hamed HassaniNeurIPS 2021 · 167 citations
- CLIPood: Generalizing CLIP to Out-of-DistributionsYang Shu, Xingzhuo Guo, Jialong Wu, Ximei Wang et al.ICML 2023 · 122 citations
- MADG: Margin-based Adversarial Learning for Domain GeneralizationAveen Dayal, Vimal K. B., Linga Reddy Cenkeramaddi, C. Krishna Mohan et al.NeurIPS 2023 · 102 citations
- Probable Domain Generalization via Quantile Risk MinimizationCian Eastwood, Alexander Robey, Shashank Singh, Julius von Kügelgen et al.NeurIPS 2022 · 99 citations
Builds on4
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Episodic Training for Domain GeneralizationDa Li, Jianshu Zhang, Yongxin Yang, Cong Liu et al.ICCV 2019 · 488 citations
- Efficient Domain Generalization via Common-Specific Low-Rank DecompositionVihari Piratla, Praneeth Netrapalli, Sunita SarawagiICML 2020 · 250 citations
Related papers
- Exploiting Domain-Specific Features to Enhance Domain GeneralizationManh-Ha Bui, Toan Tran, Anh Tran, Dinh Q. PhungNeurIPS 2021 · 182 citations
- Generalizable Decision Boundaries: Dualistic Meta-Learning for Open Set Domain GeneralizationXiran Wang, Jian Zhang, Lei Qi, Yinghuan ShiICCV 2023 · 39 citations
- Adversarial Teacher-Student Representation Learning for Domain GeneralizationFu-En Yang, Yuan-Chia Cheng, Zu-Yun Shiau, Yu-Chiang Frank WangNeurIPS 2021 · 83 citations
- Cluster, Split, Fuse, and Update: Meta-Learning for Open Compound Domain Adaptive Semantic SegmentationRui Gong, Yuhua Chen, Danda Pani Paudel, Yawei Li et al.CVPR 2021
- Compound Domain Generalization via Meta-Knowledge EncodingChaoqi Chen, Jiongcheng Li, Xiaoguang Han, Xiaoqing Liu et al.CVPR 2022 · 59 citations
