LightKG: Efficient Knowledge-Aware Recommendations with Simplified GNN Architecture
Yanhui Li, Dongxia Wang, Zhu Sun, Haonan Zhang, Huizhong Guo
Abstract
Recently, Graph Neural Networks (GNNs) have become the dominant approach for Knowledge Graph-aware Recommender Systems (KGRSs) due to their proven effectiveness. Building upon GNN-based KGRSs, Self-Supervised Learning (SSL) has been incorporated to address the sparity issue, leading to longer training time. However, through extensive experiments, we reveal that: (1)compared to other KGRSs, the existing GNN-based KGRSs fail to keep their superior performance under sparse interactions even with SSL. (2) More complex models tend to perform worse in sparse interaction scenarios and complex mechanisms, like attention mechanism, can be detrimental as they often increase learning difficulty. Inspired by these findings, we propose LightKG, a simple yet powerful GNN-based KGRS to address sparsity issues. LightKG includes a simplified GNN layer that encodes directed relations as scalar pairs rather than dense embeddings and employs a linear aggregation framework, greatly reducing the complexity of GNNs. Additionally, LightKG incorporates an efficient contrastive layer to implement SSL. It directly minimizes the node similarity in original graph, avoiding the time-consuming subgraph generation and comparison required in previous SSL methods. Experiments on four benchmark datasets show that LightKG outperforms 12 competitive KGRSs in both sparse and dense scenarios while significantly reducing training time. Specifically, it surpasses the best baselines by an average of 5.8% in recommendation accuracy and saves 84.3% of training time compared to KGRSs with SSL. Our code is available at https://github.com/1371149/LightKG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on13
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 2,360 citations
- Learning Intents behind Interactions with Knowledge Graph for RecommendationXiang Wang, Tinglin Huang, Dingxian Wang, Yancheng Yuan et al.WWW 2021 · 584 citations
- Knowledge Graph Contrastive Learning for RecommendationYuhao Yang, Chao Huang, Lianghao Xia, Chenliang LiSIGIR 2022 · 487 citations
Related papers
- Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender SystemDing Zou, Wei Wei, Xian-Ling Mao, Ziyang Wang et al.SIGIR 2022 · 226 citations
- LightGCL: Simple Yet Effective Graph Contrastive Learning for RecommendationXuheng Cai, Chao Huang, Lianghao Xia, Xubin RenICLR 2023 · 99 citations
- Self-derived Knowledge Graph Contrastive Learning for RecommendationLei Shi, Jiapeng Yang, Pengtao Lv, Lu Yuan et al.ACM MM 2024 · 18 citations
- Candidate-aware Graph Contrastive Learning for RecommendationWei He, Guohao Sun, Jinhu Lu, Xiu Susie FangSIGIR 2023 · 64 citations
- Knowledge-Enhanced Recommendation with User-Centric Subgraph NetworkGuangyi Liu, Quanming Yao, Yongqi Zhang, Lei ChenICDE 2024 · 6 citations
