Meta-Causal Learning for Single Domain Generalization
Jin Chen, Zhi Gao, Xinxiao Wu, Jiebo Luo
Abstract
Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to cover the target domains, but without estimating the domain shift between the source and target domains. In this paper, we propose a new learning paradigm, namely simulate-analyze-reduce, which first simulates the domain shift by building an auxiliary domain as the target domain, then learns to analyze the causes of domain shift, and finally learns to reduce the domain shift for model adaptation. Under this paradigm, we propose a meta-causal learning method to learn meta-knowledge, that is, how to infer the causes of domain shift between the auxiliary and source domains during training. We use the meta-knowledge to analyze the shift between the target and source domains during testing. Specifically, we perform multiple transformations on source data to generate the auxiliary domain, perform counterfactual inference to learn to discover the causal factors of the shift between the auxiliary and source domains, and incorporate the inferred causality into factor-aware domain alignments. Extensive experiments on several benchmarks of image classification show the effectiveness of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 99fffa5a-d607-49bf-89a1-cad5d9f9777bCited by top-tier papers21
- Improving Non-Transferable Representation Learning by Harnessing Content and StyleZiming Hong, Zhenyi Wang, Li Shen, Yu Yao et al.ICLR 2024 · 37 citations
- Unbiased Faster R-CNN for Single-source Domain Generalized Object DetectionYajing Liu, Shijun Zhou, Xiyao Liu, Chunhui Hao et al.CVPR 2024 · 35 citations
- Diversifying Spatial-Temporal Perception for Video Domain GeneralizationKun-Yu Lin, Jia-Run Du, Yipeng Gao, Jiaming Zhou et al.NeurIPS 2023 · 27 citations
- Learning Spectral-Decomposited Tokens for Domain Generalized Semantic SegmentationJingjun Yi, Qi Bi, Hao Zheng, Haolan Zhan et al.ACM MM 2024 · 25 citations
- L-TTA: Lightweight Test-Time Adaptation Using a Versatile Stem LayerJin Shin, Hyun KimNeurIPS 2024 · 23 citations
Builds on15
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Deep Domain-Adversarial Image Generation for Domain GeneralisationKaiyang Zhou, Yongxin Yang, Timothy M. Hospedales, Tao XiangAAAI 2020 · 488 citations
- Episodic Training for Domain GeneralizationDa Li, Jianshu Zhang, Yongxin Yang, Cong Liu et al.ICCV 2019 · 488 citations
- Domain Generalization using Causal MatchingDivyat Mahajan, Shruti Tople, Amit SharmaICML 2021 · 399 citations
- Domain Generalization Using a Mixture of Multiple Latent DomainsToshihiko Matsuura, Tatsuya HaradaAAAI 2020 · 355 citations
Related papers
- Learning to Generalize across Domains on Single Test SamplesZehao Xiao, Xiantong Zhen, Ling Shao, Cees G. M. SnoekICLR 2022 · 40 citations
- Fast Adaptation for Human Pose Estimation via Meta-OptimizationShengxiang Hu, Huaijiang Sun, Bin Li, Dong Wei et al.CVPR 2024
- Self-Domain Adaptation for Face Anti-SpoofingJingjing Wang, Jingyi Zhang, Ying Bian, Youyi Cai et al.AAAI 2021 · 111 citations
- MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain AdaptationGuoqiang Wei, Cuiling Lan, Wenjun Zeng, Zhibo ChenCVPR 2021
- Exploiting Domain-Specific Features to Enhance Domain GeneralizationManh-Ha Bui, Toan Tran, Anh Tran, Dinh Q. PhungNeurIPS 2021 · 182 citations
