Prior Refinement Is Better: Diffusion-Driven Graph Harmonization for Federated Graph Learning
Shuman Zhuang, Zhihao Wu, Wei Huang, Luojun Lin, Jiali Yin, Lele Fu, Hong-Ning Dai
Abstract
Federated Graph Learning (FGL) has emerged as a compelling paradigm for collaboratively training a global model while preserving the privacy of multi-source graphs. Nonetheless, FGL faces a critical challenge of data heterogeneity, where semantic and structural discrepancies across clients significantly degrade its performance. Although existing methods attempt to calibrate client-specific graph distributions during federated training, they inevitably fall short in aligning the optimization behaviors across clients due to dynamic parameter updates, thereby inducing a bottleneck in generalization improvement. To tackle this challenge, we propose a solution from a new perspective of prior refinement, which seeks to proactively harmonize client graph distributions before the federated training. In particular, we propose a Federated Graph Harmonization (FedGH) framework that exploits the generative strengths of graph diffusion models to perform prior refinement of local graphs. In a nutshell, FedGH designs a conditional diffusion mechanism on each client that synthesizes pseudo-graphs encapsulating both feature and structural priors, thereby facilitating explicit correction of inter-client distributional bias. On the server side, we employ the graph contrastive learning between various clientspecific pseudo-graphs to incorporate the global information, subsequently guiding local data reconstruction. Importantly, model-agnostic FedGH can be seamlessly deployed as a plugand-play module to be easily integrated with existing FGL architectures. Extensive experiments demonstrate that FedGH consistently outperforms state-of-the-art FGL baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0ffaf946-cf78-4f91-ac35-4a4ad6dd71ecBuilds on24
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Adaptive Federated OptimizationSashank J. Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett et al.ICLR 2021 · 1,917 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- FedProto: Federated Prototype Learning across Heterogeneous ClientsYue Tan, Guodong Long, Lu Liu, Tianyi Zhou et al.AAAI 2022 · 851 citations
- Subgraph Federated Learning with Missing Neighbor GenerationKe Zhang, Carl Yang, Xiaoxiao Li, Lichao Sun et al.NeurIPS 2021 · 320 citations
Related papers
- Generalizing Personalized Federated Graph Augmentation via Min-max Adversarial LearningLiang Zhang, Tao Long, Yang Liu, Lei Zhang et al.KDD 2025
- Federated Graph Learning under Domain Shift with Generalizable PrototypesGuancheng Wan, Wenke Huang, Mang YeAAAI 2024 · 70 citations
- Federated Graph Learning via Structure-Aware Fusion Using a Kalman Framework with Learnable DynamicsBisheng Tang, Xiaojun ChenICML 2026
- Horizontal Federated Heterogeneous Graph Learning: A Multi-Scale Adaptive Solution to Data Distribution ChallengesJia Wang, Yawen Li, Zhe Xue, Yingxia Shao et al.WWW 2025 · 2 citations
- AdaFGL: A New Paradigm for Federated Node Classification with Topology HeterogeneityXunkai Li, Zhengyu Wu, Wentao Zhang, Henan Sun et al.ICDE 2024 · 11 citations
