Zero-shot Recommendation: Towards Class Semantic Relation Learning for Inferring Labels of Unseen Micro-videos
Junyang Chen, Huan Wang, Yirui Wu, Qiuzhen Lin, Yunfeng Diao, Junkai Ji
Abstract
Micro-video label prediction plays a pivotal role on contemporary video-sharing platforms, such as Kwai and Tiktok. The emergence of video content lacking labels presents a formidable challenge for conventional user interest prediction methods. This paper addresses the challenge of micro-video label prediction, particularly for unseen videos, by proposing a zero-shot method called Class Semantic Relation Learning (CSRL). Unlike traditional user interest prediction models, CSRL leverages the pre-trained Large Language Model (LLM) to enhance prediction accuracy for unlabeled videos. The novelty of CSRL lies in its integration of three key components: a raw feature autoencoder, LLM-enhanced features, and a decomposed graph network. The decomposed graph network is specifically designed to disentangle the relationships between labeled and unlabeled videos, offering a significant improvement over previous methods. By fusing hidden topics with LLM-enhanced text, CSRL effectively handles sparse video features. Experiments on large-scale datasets from the Kwai platform show that CSRL achieves state-of-the-art results, with up to 44.64% improvement in Hit Ratio (HR), highlighting its superiority over existing zero-shot recommendation models in predicting user interests within the user-video network.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Generative-Contrastive Graph Learning for RecommendationYonghui Yang, Zhengwei Wu, Le Wu, Kun Zhang et al.SIGIR 2023 · 104 citations
- Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and PromptingZhihao Wen, Yuan FangSIGIR 2023 · 66 citations
- Zero-shot Node Classification with Decomposed Graph Prototype NetworkZheng Wang, Jialong Wang, Yuchen Guo, Zhiguo GongKDD 2021 · 41 citations
- Zero-shot Micro-video Classification with Neural Variational Inference in Graph Prototype NetworkJunyang Chen, Jialong Wang, Zhijiang Dai, Huisi Wu et al.ACM MM 2023 · 17 citations
- Hyperbolic Visual Embedding Learning for Zero-Shot RecognitionShaoteng Liu, Jingjing Chen, Liangming Pan, Chong-Wah Ngo et al.CVPR 2020
Related papers
- Micro-video Tagging via Jointly Modeling Social Influence and Tag RelationXiao Wang, Tian Gan, Yinwei Wei, Jianlong Wu et al.ACM MM 2022 · 8 citations
- Orthogonal Temporal Interpolation for Zero-Shot Video RecognitionYan Zhu, Junbao Zhuo, Bin Ma, Jiajia Geng et al.ACM MM 2023 · 5 citations
- Semantics Disentangling for Generalized Zero-Shot LearningZhi Chen, Yadan Luo, Ruihong Qiu, Sen Wang et al.ICCV 2021 · 143 citations
- Zero-shot Video Classification with Appropriate Web and Task Knowledge TransferJunbao Zhuo, Yan Zhu, Shuhao Cui, Shuhui Wang et al.ACM MM 2022 · 11 citations
- Consistent Structural Relation Learning for Zero-Shot SegmentationPeike Li, Yunchao Wei, Yi YangNeurIPS 2020 · 88 citations
