Breaking the Aggregation Bottleneck in Federated Recommendation: A Personalized Model Merging Approach
Jundong Chen, Honglei Zhang, Chunxu Zhang, Fangyuan Luo, Yidong Li
摘要
Federated recommendation (FR) facilitates collaborative training by aggregating local models from massive devices, enabling client-specific personalization while ensuring privacy. However, we empirically and theoretically demonstrate that server-side aggregation can undermine client-side personalization, leading to suboptimal performance, which we term the aggregation bottleneck. This issue stems from the inherent heterogeneity across numerous clients in FR, which drives the globally aggregated model to deviate from local optima. To this end, we propose FedEM, which elastically merges the global and local models to compensate for impaired personalization. Unlike existing personalized federated recommendation (pFR) methods, FedEM (1) investigates the aggregation bottleneck in FR through theoretical insights, rather than relying on heuristic analysis; (2) leverages off-the-shelf local models rather than designing additional mechanisms to boost personalization. Extensive experiments on real-world datasets demonstrate that our method preserves client personalization during collaborative training, outperforming state-of-the-art baselines. Our code is available at https://github.com/jundongchen13/FedEM .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- FedMerge: Federated Model Merging for PersonalizationShutong Chen, Tianyi Zhou, Guodong Long, Jing Jiang 等AAAI 2026 · 被引用 2 次
- TransFR: Transferable Federated Recommendation with Adapter Tuning on Pre-trained Language ModelsHonglei Zhang, Zhiwei Li, Haoxuan Li, Xin Zhou 等AAAI 2026 · 被引用 1 次
它引用的顶会 Paper19
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li 等SIGIR 2020 · 被引用 4,448 次
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi 等ICML 2020 · 被引用 3,875 次
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 被引用 1,542 次
- Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning ApproachAlireza Fallah, Aryan Mokhtari, Asuman E. OzdaglarNeurIPS 2020 · 被引用 1,354 次
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 被引用 1,313 次
相关 Paper
- Feed: Towards Personalization-Effective Federated LearningPengpeng Qiao, Kangfei Zhao, Bei Bi, Zhiwei Zhang 等ICDE 2024 · 被引用 10 次
- Co-clustering for Federated Recommender SystemXinrui He, Shuo Liu, Jacky Keung, Jingrui HeWWW 2024 · 被引用 41 次
- HeteFedRec: Federated Recommender Systems with Model HeterogeneityWei Yuan, Liang Qu, Lizhen Cui, Yongxin Tong 等ICDE 2024 · 被引用 35 次
- Personalized Federated Collaborative Filtering: A Variational AutoEncoder ApproachZhiwei Li, Guodong Long, Tianyi Zhou, Jing Jiang 等AAAI 2025 · 被引用 22 次
- Joint Item Embedding Dual-view Exploration and Adaptive Local-Global Fusion for Federated RecommendationPengyang Zhou, Chaochao Chen, Weiming Liu, Wenkai Shen 等SIGIR 2025 · 被引用 5 次
