Inductive Matrix Completion Based on Graph Neural Networks
Muhan Zhang, Yixin Chen
Abstract
We propose an inductive matrix completion model without using side information. By factorizing the (rating) matrix into the product of low-dimensional latent embeddings of rows (users) and columns (items), a majority of existing matrix completion methods are transductive, since the learned embeddings cannot generalize to unseen rows/columns or to new matrices. To make matrix completion inductive, most previous works use content (side information), such as user's age or movie's genre, to make predictions. However, high-quality content is not always available, and can be hard to extract. Under the extreme setting where not any side information is available other than the matrix to complete, can we still learn an inductive matrix completion model? In this paper, we propose an Inductive Graph-based Matrix Completion (IGMC) model to address this problem. IGMC trains a graph neural network (GNN) based purely on 1-hop subgraphs around (user, item) pairs generated from the rating matrix and maps these subgraphs to their corresponding ratings. It achieves highly competitive performance with state-of-the-art transductive baselines. In addition, IGMC is inductive -- it can generalize to users/items unseen during the training (given that their interactions exist), and can even transfer to new tasks. Our transfer learning experiments show that a model trained out of the MovieLens dataset can be directly used to predict Douban movie ratings with surprisingly good performance. Our work demonstrates that: 1) it is possible to train inductive matrix completion models without using side information while achieving similar or better performances than state-of-the-art transductive methods; 2) local graph patterns around a (user, item) pair are effective predictors of the rating this user gives to the item; and 3) Long-range dependencies might not be necessary for modeling recommender systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers52
- Handling Missing Data with Graph Representation LearningJiaxuan You, Xiaobai Ma, Daisy Yi Ding, Mykel J. Kochenderfer et al.NeurIPS 2020 · 274 citations
- Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation LearningMuhan Zhang, Pan Li, Yinglong Xia, Kai Wang et al.NeurIPS 2021 · 255 citations
- Nested Graph Neural NetworksMuhan Zhang, Pan LiNeurIPS 2021 · 213 citations
- Inductive Graph Neural Networks for Spatiotemporal KrigingYuankai Wu, Dingyi Zhuang, Aurélie Labbe, Lijun SunAAAI 2021 · 200 citations
- Knowledge Graph Reasoning with Relational DigraphYongqi Zhang, Quanming YaoWWW 2022 · 193 citations
Related papers
- ReFactor GNNs: Revisiting Factorisation-based Models from a Message-Passing PerspectiveYihong Chen, Pushkar Mishra, Luca Franceschi, Pasquale Minervini et al.NeurIPS 2022 · 24 citations
- Matrix Completion with Hierarchical Graph Side InformationAdel M. Elmahdy, Junhyung Ahn, Changho Suh, Soheil MohajerNeurIPS 2020 · 14 citations
- RetaGNN: Relational Temporal Attentive Graph Neural Networks for Holistic Sequential RecommendationCheng Hsu, Cheng-Te LiWWW 2021 · 89 citations
- INDIGO: GNN-Based Inductive Knowledge Graph Completion Using Pair-Wise EncodingShuwen Liu, Bernardo Cuenca Grau, Ian Horrocks, Egor V. KostylevNeurIPS 2021 · 128 citations
- Feature-Structure Adaptive Completion Graph Neural Network for Cold-start RecommendationSongyuan Lei, Xinglong Chang, Zhizhi Yu, Dongxiao He et al.AAAI 2025 · 9 citations
