Aligning Distillation For Cold-start Item Recommendation
Feiran Huang, Zefan Wang, Xiao Huang, Yufeng Qian, Zhetao Li, Hao Chen
Abstract
Recommending cold items in recommendation systems is a longstanding challenge due to the inherent differences between warm items, which are recommended based on user behavior, and cold items, which are recommended based on content features. To tackle this, generative models generate synthetic embeddings from content features, while dropout models enhance the robustness of the recommendation system by randomly dropping behavioral embeddings during training. However, these models primarily focus on handling the recommendation of cold items, but do not effectively address the differences between warm and cold recommendations. As a result, generative models may over-recommend either warm or cold items, neglecting the other type, and dropout models may negatively impact warm item recommendations. To address this, we propose the Aligning Distillation (ALDI) framework, which leverages warm items as "teachers" to transfer their behavioral information to cold items, referred to as "students". ALDI aligns the students with the teachers by comparing the differences in their recommendation characters, using tailored rating distribution aligning, ranking aligning, and identification aligning losses to narrow these differences. Furthermore, ALDI incorporates a teacher-qualifying weighting structure to prevent students from learning inaccurate information from unreliable teachers. Experiments on three datasets show that our approach outperforms state-of-the-art baselines in terms of overall, warm, and cold recommendation performance with three different recommendation backbones.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers18
- Macro Graph Neural Networks for Online Billion-Scale Recommender SystemsHao Chen, Yuanchen Bei, Qijie Shen, Yue Xu et al.WWW 2024 · 96 citations
- Differentiable Neuro-Symbolic Reasoning on Large-Scale Knowledge GraphsShengyuan Chen, Yunfeng Cai, Huang Fang, Xiao Huang et al.NeurIPS 2023 · 56 citations
- Richelieu: Self-Evolving LLM-Based Agents for AI DiplomacyZhenyu Guan, Xiangyu Kong, Fangwei Zhong, Yizhou WangNeurIPS 2024 · 48 citations
- Entity Alignment with Noisy Annotations from Large Language ModelsShengyuan Chen, Qinggang Zhang, Junnan Dong, Wen Hua et al.NeurIPS 2024 · 44 citations
- Content-based Graph Reconstruction for Cold-start Item RecommendationJinri Kim, Eungi Kim, Kwangeun Yeo, Yujin Jeon et al.SIGIR 2024 · 23 citations
Builds on13
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Contrastive Learning for Cold-Start RecommendationYinwei Wei, Xiang Wang, Qi Li, Liqiang Nie et al.ACM MM 2021 · 321 citations
- Understanding Knowledge Distillation in Non-autoregressive Machine TranslationChunting Zhou, Jiatao Gu, Graham NeubigICLR 2020 · 235 citations
- Few-Shot Image Recognition With Knowledge TransferZhimao Peng, Zechao Li, Junge Zhang, Yan Li et al.ICCV 2019 · 230 citations
- Online Model Distillation for Efficient Video InferenceRavi Teja Mullapudi, Steven Chen, Keyi Zhang, Deva Ramanan et al.ICCV 2019 · 131 citations
Related papers
- Leveraging Distribution Alignment via Stein Path for Cross-Domain Cold-Start RecommendationWeiming Liu, Jiajie Su, Chaochao Chen, Xiaolin ZhengNeurIPS 2021 · 80 citations
- Privileged Graph Distillation for Cold Start RecommendationShuai Wang, Kun Zhang, Le Wu, Haiping Ma et al.SIGIR 2021 · 32 citations
- How to Learn Item Representation for Cold-Start Multimedia Recommendation?Xiaoyu Du, Xiang Wang, Xiangnan He, Zechao Li et al.ACM MM 2020 · 64 citations
- Equivariant Learning for Out-of-Distribution Cold-start RecommendationWenjie Wang, Xinyu Lin, Liuhui Wang, Fuli Feng et al.ACM MM 2023 · 14 citations
- Enhancing Adversarial Robustness of Multi-modal Recommendation via Modality BalancingYu Shang, Chen Gao, Jiansheng Chen, Depeng Jin et al.ACM MM 2023 · 9 citations
