STARLINE: Contrastive Learning with Modality-Aware Graph Refinement for Effective Multimedia Recommendation
Taeri Kim, Sohee Ban, Hyunjoon Kim, Sang-Wook Kim
Abstract
Beyond using multimodal features of items in addition to user-item interactions, researchers have additionally utilized Contrastive Learning (CL) in recent multimedia recommender systems to highly alleviate the data sparsity problem. CL-based methods generate at least two embeddings (i.e., views) for each instance and enrich the information of each instance from various perspectives via the views, thereby alleviating the data sparsity problem. Therefore, CL-based methods have focused on generating views that effectively represent the characteristics of each instance for their downstream tasks. Similarly, CL-based multimedia recommender systems have made efforts to effectively generate their user/item views by leveraging items' multimodal features. However, we point out the following two limitations that they have overlooked in generating their views: (1) they either have not attempted to identify the influence of each modality feature of an item on user-item interactions, or have identified it by randomly masking or dropping user-item interactions, and (2) they have not attempted to identify non-interactions likely to result in interactions in the future. To overcome these limitations, we propose a novel multimedia recommendation framework, named STARLINE, utilizing contraSTive leARning with modaLIty-aware graph refiNEment. Extensive experiments on five real-world datasets validate the effectiveness and validity of STARLINE, especially showing consistently higher accuracy by up to 13.24% compared to the best competitor.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Refining Contrastive Learning and Homography Relations for Multi-Modal RecommendationShouxing Ma, Yawen Zeng, Shiqing Wu, Guandong XuACM MM 2025 · 3 citations
- Modal-aware Bias Constrained Contrastive Learning for Multimodal RecommendationWei Yang, Zhengru Fang, Tianle Zhang, Shiguang Wu et al.ACM MM 2023 · 15 citations
- Candidate-aware Graph Contrastive Learning for RecommendationWei He, Guohao Sun, Jinhu Lu, Xiu Susie FangSIGIR 2023 · 64 citations
- Multi-view Semantic Contrastive Alignment for Multimodal RecommendationJiuqiang Li, Hongjun WangWWW 2026
- AdaMCL: Adaptive Fusion Multi-View Contrastive Learning for Collaborative FilteringGuanghui Zhu, Wang Lu, Chunfeng Yuan, Yihua HuangSIGIR 2023 · 36 citations
