Homophily-Heterogeneity Gradient Surgery for Federated Graph Learning
Sujia Huang, Lele Fu, Shunxin Xiao, Xiaoya Zhang, Chunyan Xu, Tong Zhang, Bo Huang, Zhen Cui
Abstract
Federated Graph Learning (FGL) facilitates privacy-preserving collaborative training of graph neural networks, yet homophily heterogeneity across subgraphs can induce optimization conflicts that degrade model generalization. Many existing solutions rely on multi-channel architectures to mitigate such conflicts, which increase the burden on edge devices and lack theoretical convergence analysis. To overcome these limitations, we propose FedGCM, a novel FGL framework with Group-oriented Conflict Mitigation, which aligns inconsistent optimization objectives via a tailored gradient surgery. Specifically, FedGCM first divides clients into distinct groups based on their homophily levels, thereby avoiding exhaustive client-to-client conflict assessments. To resolve inter-group interference, we develop RPGrad, a gradient surgery mechanism based on residual projection, which integrates synergistic knowledge while filtering inter-group conflicts. The refined updates are then transmitted in a group-wise fashion, effectively alleviating optimization conflicts induced by homophily heterogeneity without augmenting the client-side burden. Furthermore, we provide a formal theoretical analysis establishing the convergence. Extensive experiments on both homophilous and heterophilous graphs demonstrate that FedGCM consistently achieves superior performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on31
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- On the Convergence of FedAvg on Non-IID DataXiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang et al.ICLR 2020 · 2,930 citations
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine et al.NeurIPS 2020 · 2,261 citations
- Tackling the Objective Inconsistency Problem in Heterogeneous Federated OptimizationJianyu Wang, Qinghua Liu, Hao Liang, Gauri Joshi et al.NeurIPS 2020 · 2,231 citations
- Adaptive Federated OptimizationSashank J. Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett et al.ICLR 2021 · 1,917 citations
Related papers
- FedSPA: Generalizable Federated Graph Learning under Homophily HeterogeneityZihan Tan, Guancheng Wan, Wenke Huang, He Li et al.CVPR 2025
- Personalized Subgraph Federated LearningJinheon Baek, Wonyong Jeong, Jiongdao Jin, Jaehong Yoon et al.ICML 2023 · 102 citations
- Federated Graph Learning with Structure Proxy AlignmentXingbo Fu, Zihan Chen, Binchi Zhang, Chen Chen et al.KDD 2024 · 11 citations
- AdaFGL: A New Paradigm for Federated Node Classification with Topology HeterogeneityXunkai Li, Zhengyu Wu, Wentao Zhang, Henan Sun et al.ICDE 2024 · 11 citations
- FedCND: Federated Graph-Level Clustering under Inter-Client Cluster Number DiscrepancyJunlong Wu, Renda Han, Wenxuan Tu, Jingxin Liu et al.WWW 2026
