Efficient Knowledge Transfer in Federated Recommendation for Joint Venture Ecosystem
Yichen Li, Yijing Shan, Yi Liu, Haozhao Wang, Cheng Wang, Wei Wang, Yi Wang, Ruixuan Li
Abstract
The current Federated Recommendation System (FedRS) focuses on personalized recommendation services and assumes clients are personalized IoT devices (e.g., mobile phones). In this paper, we deeply dive into new but practical FedRS applications within the joint venture ecosystem. Subsidiaries engage as participants with their users and items. However, in such a situation, merely exchanging item embedding is insufficient, as user bases always exhibit both overlaps and exclusive segments, demonstrating the complexity of user information. Meanwhile, directly uploading user information is a violation of privacy and unacceptable. To tackle the above challenges, we propose an efficient and privacy-enhanced Federated Recommendation for the Joint Venture Ecosystem (FR-JVE) that each client transfers more common knowledge from other clients with a distilled user's rating preference from the local dataset. More specifically, we first transform the local data into a new format and apply model inversion techniques to distill the rating preference with frozen user gradients before the federated training. Then, a bridge function is employed on each client side to align the local rating preference and aggregated global preference in a privacy-friendly manner. Finally, each client matches similar users to make a better prediction for overlapped users. From a theoretical perspective, we analyze how effectively FR-JVE can guarantee user privacy. Empirically, we show that FR-JVE achieves superior performance compared to state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f102a953-7a99-4c8b-9810-e6f486937ed3Cited by top-tier papers4
- Beyond Single Embedding: Modeling User Preferences as Distribution in Federated RecommendationChunxu Zhang, Weipeng Zhang, Guodong Long, Zhiheng Xue et al.ICML 2026
- Data-Centric Sequential Recommendation with Relation-Augmented GenerationYichen Li, Yichen Tan, Yijing Shan, Haozhao Wang et al.AAAI 2026
- Federated Manifold Learning (FML): Tackling Domain Heterogeneity with Structural Knowledge TransferXutong Mu, Yanbiao Ma, Jia Shi, Xueli Geng et al.ICML 2026
- FedCD: Towards Consolidated Distillation for Heterogeneous Federated LearningYichen Li, Hang Su, Huifa Li, Haolin Yang et al.AAAI 2026
Builds on13
- Ensemble Distillation for Robust Model Fusion in Federated LearningTao Lin, Lingjing Kong, Sebastian U. Stich, Martin JaggiNeurIPS 2020 · 1,615 citations
- Data-Free Knowledge Distillation for Heterogeneous Federated LearningZhuangdi Zhu, Junyuan Hong, Jiayu ZhouICML 2021 · 957 citations
- Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated LearningLin Zhang, Li Shen, Liang Ding, Dacheng Tao et al.CVPR 2022 · 339 citations
- FedFast: Going Beyond Average for Faster Training of Federated Recommender SystemsKhalil Muhammad, Qinqin Wang, Diarmuid O'Reilly-Morgan, Elias Z. Tragos et al.KDD 2020 · 215 citations
- Federated Class-Incremental LearningJiahua Dong, Lixu Wang, Zhen Fang, Gan Sun et al.CVPR 2022 · 197 citations
Related papers
- Personalized Federated Recommendation for Cold-Start Users via Adaptive Knowledge FusionYichen Li, Yijing Shan, Yi Liu, Haozhao Wang et al.WWW 2025 · 25 citations
- TransFR: Transferable Federated Recommendation with Adapter Tuning on Pre-trained Language ModelsHonglei Zhang, Zhiwei Li, Haoxuan Li, Xin Zhou et al.AAAI 2026 · 1 citation
- GPFedRec: Graph-Guided Personalization for Federated RecommendationChunxu Zhang, Guodong Long, Tianyi Zhou, Zijian Zhang et al.KDD 2024 · 26 citations
- AeroRec: An Efficient On-Device Recommendation Framework using Federated Self-Supervised Knowledge DistillationTengxi Xia, Ju Ren, Wei Rao, Qin Zu et al.INFOCOM 2024 · 2 citations
- Learning Evolving Preferences: A Federated Continual Framework for User-Centric RecommendationChunxu Zhang, Zhiheng Xue, Guodong Long, Weipeng Zhang et al.WWW 2026
