The Aggregated Model is a Confounder: Enabling Deconfounded Federated Learning for OOD Generalization
Jiayuan Zhang, Xuefeng Liu, Jianwei Niu, Haotian Yang, Wanyu Lin, Xinghao Wu
Abstract
Federated Learning (FL) enables collaborative model training across edge devices without sharing raw data. However, most FL approaches suffer from severe performance degradation when deployed to unseen edges with distribution shifts, known as the out-of-distribution (OOD) generalization problem. Given that causal relationships between inputs and labels are typically invariant under OOD scenarios, causality-inspired FL has attracted increasing attention. Existing works primarily focus on eliminating spurious correlations within each client’s local data while overlooking a critical step in FL, model aggregation. We show that in a structural causal graph, the aggregated model is a confounder leading to reliance on spurious correlations. To address this problem, we introduce a Federated Deconfounding learning (FedDEC) framework based on backdoor adjustment to eliminate the confounding paths. Theoretically, backdoor adjustment requires enumerating aggregated models under all possible aggregation weights, which is infeasible in practice. To efficiently approximate this process, FedDEC proposes a client-side disentangled feature learning module that separates personalized and global components. It also introduces a deconfounded training module that computes cross-attention between the personalized features and a server-maintained prototype bank to obtain deconfounded causal features. Experiments demonstrate that FedDEC achieves higher accuracy while maintaining comparable convergence speed compared to state-of-the-art algorithms.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 1daccf93-201c-420b-874a-e794984ba419Cited by top-tier papers2
- Enhancing Visual Representation with Textual Semantics: Textual Semantics-Powered Prototypes for Heterogeneous Federated LearningXinghao Wu, Jianwei Niu, Xuefeng Liu, Guogang Zhu et al.CVPR 2026 · 4 citations
- FedPDG: Prediction Discrepancy–Guided Data Generation for Heterogeneous Federated LearningYuqi Wang, Jianwei Niu, Xinghao Wu, Xuefeng Liu et al.ICML 2026
Related papers
- Causality Inspired Federated Learning for OOD GeneralizationJiayuan Zhang, Xuefeng Liu, Jianwei Niu, Shaojie Tang et al.ICML 2025
- FedGOG: Federated Graph Out-of-Distribution Generalization with Diffusion Data Exploration and Latent Embedding DecorrelationPengyang Zhou, Chaochao Chen, Weiming Liu, Xinting Liao et al.AAAI 2025 · 8 citations
- Learning Personalized Causally Invariant Representations for Heterogeneous Federated ClientsXueyang Tang, Song Guo, Jie Zhang, Jingcai GuoICLR 2024 · 10 citations
- Causally Motivated Personalized Federated Invariant Learning with Shortcut-Averse Information-Theoretic RegularizationXueyang Tang, Song Guo, Jingcai Guo, Jie Zhang et al.ICML 2024 · 4 citations
- Federated Causally Invariant Feature LearningXianjie Guo, Kui Yu, Lizhen Cui, Han Yu et al.AAAI 2025 · 4 citations
