Breaking the Aggregation Bottleneck in Federated Recommendation: A Personalized Model Merging Approach
Jundong Chen, Honglei Zhang, Chunxu Zhang, Fangyuan Luo, Yidong Li
Abstract
Federated recommendation (FR) facilitates collaborative training by aggregating local models from massive devices, enabling client-specific personalization while ensuring privacy. However, we empirically and theoretically demonstrate that server-side aggregation can undermine client-side personalization, leading to suboptimal performance, which we term the aggregation bottleneck. This issue stems from the inherent heterogeneity across numerous clients in FR, which drives the globally aggregated model to deviate from local optima. To this end, we propose FedEM, which elastically merges the global and local models to compensate for impaired personalization. Unlike existing personalized federated recommendation (pFR) methods, FedEM (1) investigates the aggregation bottleneck in FR through theoretical insights, rather than relying on heuristic analysis; (2) leverages off-the-shelf local models rather than designing additional mechanisms to boost personalization. Extensive experiments on real-world datasets demonstrate that our method preserves client personalization during collaborative training, outperforming state-of-the-art baselines. Our code is available at https://github.com/jundongchen13/FedEM .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 04b5738c-ed84-4aba-af66-29922e424b66Cited by top-tier papers2
- FedMerge: Federated Model Merging for PersonalizationShutong Chen, Tianyi Zhou, Guodong Long, Jing Jiang et al.AAAI 2026 · 2 citations
- TransFR: Transferable Federated Recommendation with Adapter Tuning on Pre-trained Language ModelsHonglei Zhang, Zhiwei Li, Haoxuan Li, Xin Zhou et al.AAAI 2026 · 1 citation
Builds on19
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- SCAFFOLD: Stochastic Controlled Averaging for Federated LearningSai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank J. Reddi et al.ICML 2020 · 3,875 citations
- Personalized Federated Learning with Moreau EnvelopesCanh T. Dinh, Nguyen Hoang Tran, Tuan Dung NguyenNeurIPS 2020 · 1,542 citations
- Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning ApproachAlireza Fallah, Aryan Mokhtari, Asuman E. OzdaglarNeurIPS 2020 · 1,354 citations
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 1,313 citations
Related papers
- Feed: Towards Personalization-Effective Federated LearningPengpeng Qiao, Kangfei Zhao, Bei Bi, Zhiwei Zhang et al.ICDE 2024 · 10 citations
- Co-clustering for Federated Recommender SystemXinrui He, Shuo Liu, Jacky Keung, Jingrui HeWWW 2024 · 41 citations
- HeteFedRec: Federated Recommender Systems with Model HeterogeneityWei Yuan, Liang Qu, Lizhen Cui, Yongxin Tong et al.ICDE 2024 · 35 citations
- Personalized Federated Collaborative Filtering: A Variational AutoEncoder ApproachZhiwei Li, Guodong Long, Tianyi Zhou, Jing Jiang et al.AAAI 2025 · 22 citations
- Joint Item Embedding Dual-view Exploration and Adaptive Local-Global Fusion for Federated RecommendationPengyang Zhou, Chaochao Chen, Weiming Liu, Wenkai Shen et al.SIGIR 2025 · 5 citations
