FedSDWC: Federated Synergistic Dual-Representation Weak Causal Learning for OOD
Zhenyuan Huang, Hui Zhang, Wenzhong Tang, Haijun Yang
Abstract
Amid growing demands for data privacy and advances in computational infrastructure, federated learning (FL) has emerged as a prominent distributed learning paradigm. Nevertheless, differences in data distribution (such as covariate and semantic shifts) severely affect its reliability in real-world deployments. To address this issue, we propose FedSDWC, a causal inference method that integrates both invariant and variant features. FedSDWC infers causal semantic representations by modeling the weak causal influence between invariant and variant features, effectively overcoming the limitations of existing invariant learning methods in accurately capturing invariant features and directly constructing causal representations. This approach significantly enhances FL's ability to generalize and detect OOD data. Theoretically, we derive FedSDWC's generalization error bound under specific conditions and, for the first time, establish its relationship with client prior distributions. Moreover, extensive experiments conducted on multiple benchmark datasets validate the superior performance of FedSDWC in handling covariate and semantic shifts. For example, FedSDWC outperforms FedICON, the next best baseline, by an average of 3.04% on CIFAR-10 and 8.11% on CIFAR-100.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bddb13b9-b2a3-4279-84b2-0fba72b7c559Builds on36
- Out-of-Distribution Detection with Deep Nearest NeighborsYiyou Sun, Yifei Ming, Xiaojin Zhu, Yixuan LiICML 2022 · 789 citations
- Test-Time Classifier Adjustment Module for Model-Agnostic Domain GeneralizationYusuke Iwasawa, Yutaka MatsuoNeurIPS 2021 · 456 citations
- Mitigating Neural Network Overconfidence with Logit NormalizationHongxin Wei, Renchunzi Xie, Hao Cheng, Lei Feng et al.ICML 2022 · 386 citations
- Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoderZhisheng Xiao, Qing Yan, Yali AmitNeurIPS 2020 · 234 citations
- ViM: Out-Of-Distribution with Virtual-logit MatchingHaoqi Wang, Zhizhong Li, Litong Feng, Wayne ZhangCVPR 2022 · 227 citations
Related papers
- FOOGD: Federated Collaboration for Both Out-of-distribution Generalization and DetectionXinting Liao, Weiming Liu, Pengyang Zhou, Fengyuan Yu et al.NeurIPS 2024 · 24 citations
- Federated Causally Invariant Feature LearningXianjie Guo, Kui Yu, Lizhen Cui, Han Yu et al.AAAI 2025 · 4 citations
- Causally Motivated Personalized Federated Invariant Learning with Shortcut-Averse Information-Theoretic RegularizationXueyang Tang, Song Guo, Jingcai Guo, Jie Zhang et al.ICML 2024 · 4 citations
- Causality Inspired Federated Learning for OOD GeneralizationJiayuan Zhang, Xuefeng Liu, Jianwei Niu, Shaojie Tang et al.ICML 2025
- Learning Personalized Causally Invariant Representations for Heterogeneous Federated ClientsXueyang Tang, Song Guo, Jie Zhang, Jingcai GuoICLR 2024 · 10 citations
