PEPPER: Empowering User-Centric Recommender Systems over Gossip Learning
Yacine Belal, Aurélien Bellet, Sonia Ben Mokhtar, Vlad Nitu
Abstract
Recommender systems are proving to be an invaluable tool for extracting user-relevant content helping users in their daily activities (e.g., finding relevant places to visit, content to consume, items to purchase). However, to be effective, these systems need to collect and analyze large volumes of personal data (e.g., location check-ins, movie ratings, click rates .. etc.), which exposes users to numerous privacy threats. In this context, recommender systems based on Federated Learning (FL) appear to be a promising solution for enforcing privacy as they compute accurate recommendations while keeping personal data on the users' devices. However, FL, and therefore FL-based recommender systems, rely on a central server that can experience scalability issues besides being vulnerable to attacks. To remedy this, we propose PEPPER, a decentralized recommender system based on gossip learning principles. In PEPPER, users gossip model updates and aggregate them asynchronously. At the heart of PEPPER reside two key components: a personalized peer-sampling protocol that keeps in the neighborhood of each node, a proportion of nodes that have similar interests to the former and a simple yet effective model aggregation function that builds a model that is better suited to each user. Through experiments on three real datasets implementing two use cases: a location check-in recommendation and a movie recommendation, we demonstrate that our solution converges up to 42% faster than with other decentralized solutions providing up to 9% improvement on average performance metric such as hit ratio and up to 21% improvement on long tail performance compared to decentralized competitors.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1f11bdb9-2f38-4762-b20d-fe8dec528677Cited by top-tier papers1
Ask how each one uses itBuilds on8
- Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated LearningMilad Nasr, Reza Shokri, Amir HoumansadrS&P 2019 · 1,778 citations
- Attack of the Tails: Yes, You Really Can Backdoor Federated LearningHongyi Wang, Kartik Sreenivasan, Shashank Rajput, Harit Vishwakarma et al.NeurIPS 2020 · 862 citations
- FedFast: Going Beyond Average for Faster Training of Federated Recommender SystemsKhalil Muhammad, Qinqin Wang, Diarmuid O'Reilly-Morgan, Elias Z. Tragos et al.KDD 2020 · 215 citations
- You Are Who You Know and How You Behave: Attribute Inference Attacks via Users' Social Friends and BehaviorsNeil Zhenqiang Gong, Bin LiuUSENIX Security 2016 · 156 citations
- PREFER: Point-of-interest REcommendation with efficiency and privacy-preservation via Federated Edge leaRningYeting Guo, Fang Liu, Zhiping Cai, Hui Zeng et al.UbiComp 2021 · 42 citations
Related papers
- AeroRec: An Efficient On-Device Recommendation Framework using Federated Self-Supervised Knowledge DistillationTengxi Xia, Ju Ren, Wei Rao, Qin Zu et al.INFOCOM 2024 · 2 citations
- Semi-decentralized Federated Ego Graph Learning for RecommendationLiang Qu, Ningzhi Tang, Ruiqi Zheng, Quoc Viet Hung Nguyen et al.WWW 2023 · 71 citations
- Improving the Model Consistency of Decentralized Federated LearningYifan Shi, Li Shen, Kang Wei, Yan Sun et al.ICML 2023 · 89 citations
- Efficient-FedRec: Efficient Federated Learning Framework for Privacy-Preserving News RecommendationJingwei Yi, Fangzhao Wu, Chuhan Wu, Ruixuan Liu et al.EMNLP 2021 · 50 citations
- Decentralized Directed Collaboration for Personalized Federated LearningYingqi Liu, Yifan Shi, Baoyuan Wu, Qinglun Li et al.CVPR 2024
