Prototype-Aligned Federated Soft-Prompts for Continual Web Personalization
Canran Xiao, Liwei Hou
Abstract
Continual Web personalization is essential for engagement, yet real-world non-stationarity and privacy constraints make it hard to adapt quickly without forgetting long-term preferences. We target this gap by seeking a privacy-conscious, parameter-efficient interface that controls stability-plasticity at the user/session level while tying user memory to a shared semantic prior. We propose ProtoFed-SP, a prompt-based framework that injects dual-timescale soft prompts into a frozen backbone: a fast, sparse short-term prompt tracks session intent, while a slow long-term prompt is anchored to a small server-side prototype library that is continually refreshed via differentially private federated aggregation. Queries are routed to Top-𝑀 prototypes to compose a personalized prompt. Across eight benchmarks, ProtoFed-SP improves NDCG@10 by +2.9% and HR@10 by +2.0% over the strongest baselines, with notable gains on Amazon-Books (+5.0% NDCG vs. INFER), H&M (+2.5% vs. Dual-LoRA), and Taobao (+2.2% vs. FedRAP). It also lowers forgetting (AF) and Steps-to-95% and preserves accuracy under practical DP budgets. Our contribution is a unifying, privacy-aware prompting interface with prototype anchoring that delivers robust continual personalization and offers a transparent, controllable mechanism to balance stability and plasticity in deployment. CCS Concepts • Computing methodologies → Distributed algorithms; Artificial intelligence.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4ba5a00d-90ad-45fe-b70c-198c4d583e1eCited by top-tier papers1
Ask how each one uses itBuilds on17
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Ditto: Fair and Robust Federated Learning Through PersonalizationTian Li, Shengyuan Hu, Ahmad Beirami, Virginia SmithICML 2021 · 1,313 citations
- NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates SpaceJiawei Yao, Chuming Li, Keqiang Sun, Yingjie Cai et al.ICCV 2023 · 150 citations
- The Power of Scale for Parameter-Efficient Prompt TuningBrian Lester, Rami Al-Rfou, Noah ConstantEMNLP 2021 · 94 citations
- UltraRE: Enhancing RecEraser for Recommendation Unlearning via Error DecompositionYuyuan Li, Chaochao Chen, Yizhao Zhang, Weiming Liu et al.NeurIPS 2023 · 90 citations
Related papers
- Personalized Federated Continual Learning via Multi-Granularity PromptHao Yu, Xin Yang, Xin Gao, Yan Kang et al.KDD 2024 · 12 citations
- Privacy-Preserving Personalized Federated Prompt Learning for Multimodal Large Language ModelsLinh Tran, Wei Sun, Stacy Patterson, Ana L. MilanovaICLR 2025
- Learning Evolving Preferences: A Federated Continual Framework for User-Centric RecommendationChunxu Zhang, Zhiheng Xue, Guodong Long, Weipeng Zhang et al.WWW 2026
- Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang et al.CVPR 2022 · 635 citations
- Consistent Prompting for Rehearsal-Free Continual LearningZhanxin Gao, Jun Cen, Xiaobin ChangCVPR 2024
