Domain Generalization via Rationale Invariance
Liang Chen, Yong Zhang, Yibing Song, Anton van den Hengel, Lingqiao Liu
Abstract
This paper offers a new perspective to ease the challenge of domain generalization, which involves maintaining robust results even in unseen environments. Our design focuses on the decision-making process in the final classifier layer. Specifically, we propose treating the element-wise contributions to the final results as the rationale for making a decision and representing the rationale for each sample as a matrix. For a well-generalized model, we suggest the rationale matrices for samples belonging to the same category should be similar, indicating the model relies on domain-invariant clues to make decisions, thereby ensuring robust results. To implement this idea, we introduce a rationale invariance loss as a simple regularization technique, requiring only a few lines of code. Our experiments demonstrate that the proposed approach achieves competitive results across various datasets, despite its simplicity. Code is available at https://github.com/liangchen527/RIDG.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
12 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Out-of-Distribution Generalization via Risk Extrapolation (REx) cites In Search of Lost Domain Generalization
- Generalizable Sensor-Based Activity Recognition via Categorical Concept Invariant Learning cites In Search of Lost Domain Generalization
- LFME: A Simple Framework for Learning from Multiple Experts in Domain Generalization cites Out-of-Distribution Generalization via Risk Extrapolation (REx)
- LFME: A Simple Framework for Learning from Multiple Experts in Domain Generalization cites Moment Matching for Multi-Source Domain Adaptation
- LFME: A Simple Framework for Learning from Multiple Experts in Domain Generalization cites In Search of Lost Domain Generalization
- WILDS: A Benchmark of in-the-Wild Distribution Shifts cites Moment Matching for Multi-Source Domain Adaptation
- Reasoning-Driven Multimodal LLM for Domain Generalization cites Out-of-Distribution Generalization via Risk Extrapolation (REx)
- In Search of Lost Domain Generalization cites Moment Matching for Multi-Source Domain Adaptation
Cited by top-tier papers12
- Exploring Semantic Consistency and Style Diversity for Domain Generalized Semantic SegmentationHongwei Niu, Linhuang Xie, Jianghang Lin, Shengchuan ZhangAAAI 2025 · 16 citations
- LFME: A Simple Framework for Learning from Multiple Experts in Domain GeneralizationLiang Chen, Yong Zhang, Yibing Song, Zhiqiang Shen et al.NeurIPS 2024 · 15 citations
- Activate and Reject: Towards Safe Domain Generalization under Category ShiftChaoqi Chen, Luyao Tang, Leitian Tao, Hong-Yu Zhou et al.ICCV 2023 · 15 citations
- Reasoning-Driven Multimodal LLM for Domain GeneralizationZhipeng Xu, Zilong Wang, Xinyang Jiang, Dongsheng Li et al.ICLR 2026 · 11 citations
- Generalizable Sensor-Based Activity Recognition via Categorical Concept Invariant LearningDi Xiong, Shuoyuan Wang, Lei Zhang, Wenbo Huang et al.AAAI 2025 · 10 citations
Builds on27
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- WILDS: A Benchmark of in-the-Wild Distribution ShiftsPang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie et al.ICML 2021 · 1,773 citations
- In Search of Lost Domain GeneralizationIshaan Gulrajani, David Lopez-PazICLR 2021 · 1,416 citations
- Out-of-Distribution Generalization via Risk Extrapolation (REx)David Krueger, Ethan Caballero, Jörn-Henrik Jacobsen, Amy Zhang et al.ICML 2021 · 1,163 citations
- Improving robustness against common corruptions by covariate shift adaptationSteffen Schneider, Evgenia Rusak, Luisa Eck, Oliver Bringmann et al.NeurIPS 2020 · 688 citations
Related papers
- DomainDrop: Suppressing Domain-Sensitive Channels for Domain GeneralizationJintao Guo, Lei Qi, Yinghuan ShiICCV 2023 · 47 citations
- Domain Generalization via Feature Variation DecorrelationChang Liu, Lichen Wang, Kai Li, Yun FuACM MM 2021 · 21 citations
- Interpret Your Decision: Logical Reasoning Regularization for Generalization in Visual ClassificationZhaorui Tan, Xi Yang, Qiufeng Wang, Anh Nguyen et al.NeurIPS 2024 · 8 citations
- Mix and Reason: Reasoning over Semantic Topology with Data Mixing for Domain GeneralizationChaoqi Chen, Luyao Tang, Feng Liu, Gangming Zhao et al.NeurIPS 2022 · 43 citations
- RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective WhiteningSungha Choi, Sanghun Jung, Huiwon Yun, Joanne Taery Kim et al.CVPR 2021
