The Aggregated Model is a Confounder: Enabling Deconfounded Federated Learning for OOD Generalization
Jiayuan Zhang, Xuefeng Liu, Jianwei Niu, Haotian Yang, Wanyu Lin, Xinghao Wu
摘要
Federated Learning (FL) enables collaborative model training across edge devices without sharing raw data. However, most FL approaches suffer from severe performance degradation when deployed to unseen edges with distribution shifts, known as the out-of-distribution (OOD) generalization problem. Given that causal relationships between inputs and labels are typically invariant under OOD scenarios, causality-inspired FL has attracted increasing attention. Existing works primarily focus on eliminating spurious correlations within each client’s local data while overlooking a critical step in FL, model aggregation. We show that in a structural causal graph, the aggregated model is a confounder leading to reliance on spurious correlations. To address this problem, we introduce a Federated Deconfounding learning (FedDEC) framework based on backdoor adjustment to eliminate the confounding paths. Theoretically, backdoor adjustment requires enumerating aggregated models under all possible aggregation weights, which is infeasible in practice. To efficiently approximate this process, FedDEC proposes a client-side disentangled feature learning module that separates personalized and global components. It also introduces a deconfounded training module that computes cross-attention between the personalized features and a server-maintained prototype bank to obtain deconfounded causal features. Experiments demonstrate that FedDEC achieves higher accuracy while maintaining comparable convergence speed compared to state-of-the-art algorithms.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper2
- Enhancing Visual Representation with Textual Semantics: Textual Semantics-Powered Prototypes for Heterogeneous Federated LearningXinghao Wu, Jianwei Niu, Xuefeng Liu, Guogang Zhu 等CVPR 2026 · 被引用 4 次
- FedPDG: Prediction Discrepancy–Guided Data Generation for Heterogeneous Federated LearningYuqi Wang, Jianwei Niu, Xinghao Wu, Xuefeng Liu 等ICML 2026
相关 Paper
- Causality Inspired Federated Learning for OOD GeneralizationJiayuan Zhang, Xuefeng Liu, Jianwei Niu, Shaojie Tang 等ICML 2025
- FedGOG: Federated Graph Out-of-Distribution Generalization with Diffusion Data Exploration and Latent Embedding DecorrelationPengyang Zhou, Chaochao Chen, Weiming Liu, Xinting Liao 等AAAI 2025 · 被引用 8 次
- Learning Personalized Causally Invariant Representations for Heterogeneous Federated ClientsXueyang Tang, Song Guo, Jie Zhang, Jingcai GuoICLR 2024 · 被引用 10 次
- Causally Motivated Personalized Federated Invariant Learning with Shortcut-Averse Information-Theoretic RegularizationXueyang Tang, Song Guo, Jingcai Guo, Jie Zhang 等ICML 2024 · 被引用 4 次
- Federated Causally Invariant Feature LearningXianjie Guo, Kui Yu, Lizhen Cui, Han Yu 等AAAI 2025 · 被引用 4 次
