Self-Supervised Hypergraph Transformer for Recommender Systems
Lianghao Xia, Chao Huang, Chuxu Zhang
Abstract
Graph Neural Networks (GNNs) have been shown as promising solutions for collaborative filtering (CF) with the modeling of useritem interaction graphs. The key idea of existing GNN-based recommender systems is to recursively perform the message passing along the user-item interaction edge for refining the encoded embeddings. Despite their effectiveness, however, most of the current recommendation models rely on sufficient and high-quality training data, such that the learned representations can well capture accurate user preference. User behavior data in many practical recommendation scenarios is often noisy and exhibits skewed distribution, which may result in suboptimal representation performance in GNN-based models. In this paper, we propose SHT, a novel Self-Supervised Hypergraph Transformer framework (SHT) which augments user representations by exploring the global collaborative relationships in an explicit way. Specifically, we first empower the graph neural CF paradigm to maintain global collaborative effects among users and items with a hypergraph transformer network. With the distilled global context, a cross-view generative self-supervised learning component is proposed for data augmentation over the user-item interaction graph, so as to enhance the robustness of recommender systems. Extensive experiments demonstrate that SHT can significantly improve the performance over various stateof-the-art baselines. Further ablation studies show the superior representation ability of our SHT recommendation framework in alleviating the data sparsity and noise issues. The source code and evaluation datasets are available at: https://github.com/akaxlh/SHT . CCS CONCEPTS • Information systems → Recommender systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 951c5874-d4d7-44d3-8d77-ab3d34fc4815Cited by top-tier papers25
- LGMRec: Local and Global Graph Learning for Multimodal RecommendationZhiqiang Guo, Jianjun Li, Guohui Li, Chaoyang Wang et al.AAAI 2024 · 164 citations
- Automated Self-Supervised Learning for RecommendationLianghao Xia, Chao Huang, Chunzhen Huang, Kangyi Lin et al.WWW 2023 · 141 citations
- LightGCL: Simple Yet Effective Graph Contrastive Learning for RecommendationXuheng Cai, Chao Huang, Lianghao Xia, Xubin RenICLR 2023 · 99 citations
- TransGNN: Harnessing the Collaborative Power of Transformers and Graph Neural Networks for Recommender SystemsPeiyan Zhang, Yuchen Yan, Xi Zhang, Chaozhuo Li et al.SIGIR 2024 · 82 citations
- Graph Masked Autoencoder for Sequential RecommendationYaowen Ye, Lianghao Xia, Chao HuangSIGIR 2023 · 63 citations
Builds on17
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Self-supervised Graph Learning for RecommendationJiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He et al.SIGIR 2021 · 1,476 citations
- Graph Representation Learning via Graphical Mutual Information MaximizationZhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng et al.WWW 2020 · 682 citations
- Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network ApproachLei Chen, Le Wu, Richang Hong, Kun Zhang et al.AAAI 2020 · 634 citations
- Disentangled Graph Collaborative FilteringXiang Wang, Hongye Jin, An Zhang, Xiangnan He et al.SIGIR 2020 · 621 citations
Related papers
- Hypergraph Contrastive Collaborative FilteringLianghao Xia, Chao Huang, Yong Xu, Jiashu Zhao et al.SIGIR 2022 · 445 citations
- Graph Transformer for RecommendationChaoliu Li, Lianghao Xia, Xubin Ren, Yaowen Ye et al.SIGIR 2023 · 85 citations
- SelfGNN: Self-Supervised Graph Neural Networks for Sequential RecommendationYuxi Liu, Lianghao Xia, Chao HuangSIGIR 2024 · 62 citations
- Learning to Denoise Unreliable Interactions for Graph Collaborative FilteringChangxin Tian, Yuexiang Xie, Yaliang Li, Nan Yang et al.SIGIR 2022 · 109 citations
- Semantic Enhanced Heterogeneous Hypergraph Network for Collaborative FilteringMingtao Xu, Wei Wei, Peixuan Yang, Hulong WuAAAI 2025 · 4 citations
