Personalized Fashion Compatibility Modeling via Metapath-guided Heterogeneous Graph Learning
Weili Guan, Fangkai Jiao, Xuemeng Song, Haokun Wen, Chung-Hsing Yeh, Xiaojun Chang
Abstract
Fashion Compatibility Modeling (FCM) is a new yet challenging task, which aims to automatically access the matching degree among a set of complementary items. Most of existing methods evaluate the fashion compatibility from the common perspective, but overlook the user's personal preference. Inspired by this, a few pioneers study the Personalized Fashion Compatibility Modeling (PFCM). Despite their significance, these PFCM methods mainly concentrate on the user and item entities, as well as their interactions, but ignore the attribute entities, which contain rich semantics. To address this problem, we propose to fully explore the related entities and their relations involved in PFCM to boost the PFCM performance. This is, however, non-trivial due to the heterogeneous contents of different entities, embeddings for new users, and various high-order relations. Towards these ends, we present a novel metapath-guided personalized fashion compatibility modeling, dubbed as MG-PFCM. In particular, we creatively build a heterogeneous graph to unify the three types of entities (i.e., users, items, and attributes) and their relations (i.e., user-item interactions, item-item matching relations, and item-attribute association relations). Thereafter, we design a multi-modal content-oriented user embedding module to learn user representations by inheriting the contents of their interacted items. Meanwhile, we define the user-oriented and item-oriented metapaths, and perform the metapath-guided heterogeneous graph learning to enhance the user and item embeddings. In addition, we introduce the contrastive regularization to improve the model performance. We conduct extensive experiments on the real-world benchmark dataset, which verifies the superiority of our proposed scheme over several cutting-edge baselines. As a byproduct, we have released our source codes to benefit other researchers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e4816d52-a654-4484-880e-df13d8100a7fCited by top-tier papers2
- Simple and Efficient Heterogeneous Temporal Graph Neural NetworkYili Wang, Tairan Huang, Changlong He, Qiutong Li et al.NeurIPS 2025 · 8 citations
- Seq-HGNN: Learning Sequential Node Representation on Heterogeneous GraphChenguang Du, Kaichun Yao, Hengshu Zhu, Deqing Wang et al.SIGIR 2023 · 7 citations
Builds on6
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph EmbeddingXinyu Fu, Jiani Zhang, Ziqiao Meng, Irwin KingWWW 2020 · 1,149 citations
- Heterogeneous Graph Neural Network via Attribute CompletionDi Jin, Cuiying Huo, Chundong Liang, Liang YangWWW 2021 · 220 citations
- Hierarchical Fashion Graph Network for Personalized Outfit RecommendationXingchen Li, Xiang Wang, Xiangnan He, Long Chen et al.SIGIR 2020 · 124 citations
- Multimodal Compatibility Modeling via Exploring the Consistent and Complementary CorrelationsWeili Guan, Haokun Wen, Xuemeng Song, Chung-Hsing Yeh et al.ACM MM 2021 · 33 citations
Related papers
- Modeling Multi-Relational Connectivity for Personalized Fashion MatchingYujuan Ding, P. Y. Mok, Yi Bin, Xun Yang et al.ACM MM 2023 · 14 citations
- Learning to Match on Graph for Fashion Compatibility ModelingXun Yang, Xiaoyu Du, Meng WangAAAI 2020 · 43 citations
- Complementary Factorization towards Outfit Compatibility ModelingTianyu Su, Xuemeng Song, Na Zheng, Weili Guan et al.ACM MM 2021 · 18 citations
- Collocation and Try-on Network: Whether an Outfit is CompatibleNa Zheng, Xuemeng Song, Qingying Niu, Xue Dong et al.ACM MM 2021 · 23 citations
- OutfitNet: Fashion Outfit Recommendation with Attention-Based Multiple Instance LearningYusan Lin, Maryam Moosaei, Hao YangWWW 2020 · 36 citations
