Self-Supervised Heterogeneous Graph Learning: a Homophily and Heterogeneity View
Yujie Mo, Feiping Nie, Ping Hu, Heng Tao Shen, Zheng Zhang, Xinchao Wang, Xiaofeng Zhu
Abstract
Self-supervised heterogeneous graph learning has achieved promising results in various real applications, but it still suffers from the following issues: (i) metapaths can be employed to capture the homophily in the heterogeneous graph, but meta-paths are human-defined, requiring substantial expert knowledge and computational costs; and (ii) the heterogeneity in the heterogeneous graph is usually underutilized, leading to the loss of task-related information. To solve these issues, this paper proposes to capture both homophily and heterogeneity in the heterogeneous graph without pre-defined meta-paths. Specifically, we propose to learn a self-expressive matrix to capture the homophily from the subspace and nearby neighbors. Meanwhile, we propose to capture the heterogeneity by aggregating the information of nodes from different types. We further design a consistency loss and a specificity loss, respectively, to extract the consistent information between homophily and heterogeneity and to preserve their specific task-related information.
We theoretically analyze that the learned homophilous representations exhibit the grouping effect to capture the homophily, and considering both homophily and heterogeneity introduces more task-related information. Extensive experimental results verify the superiority of the proposed method on different downstream tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2e89edb7-d1f9-47c6-816b-39dcfc329623Cited by top-tier papers9
- Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering PerspectiveYujie Mo, Zhihe Lu, Runpeng Yu, Xiaofeng Zhu et al.NeurIPS 2024 · 15 citations
- GraphLearner: Graph Node Clustering with Fully Learnable AugmentationXihong Yang, Erxue Min, Ke Liang, Yue Liu et al.ACM MM 2024 · 14 citations
- Multiplex Graph Representation Learning with Homophily and ConsistencyYudi Huang, Ci Nie, Hongqing He, Yujie Mo et al.AAAI 2025 · 3 citations
- MUG: Meta-path-aware Universal Heterogeneous Graph Pre-TrainingLianze Shan, Jitao Zhao, Dongxiao He, Yongqi Huang et al.AAAI 2026 · 1 citation
- Enhancing Homophily-Heterophily Separation: Relation-Aware Learning in Heterogeneous GraphsZiyu Zheng, Yaming Yang, Ziyu Guan, Wei Zhao et al.KDD 2025 · 1 citation
Builds on27
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun et al.ICML 2021 · 2,942 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
Related papers
- Enhancing Homophily in Heterogeneous Graph Contrastive Learning via Connection Strength and Multi-view Self-ExpressionHaosen Wang, Chenglong Shi, Can Xu, Surong Yan et al.SIGIR 2025 · 1 citation
- Automated Self-Supervised Learning for GraphsWei Jin, Xiaorui Liu, Xiangyu Zhao, Yao Ma et al.ICLR 2022 · 95 citations
- Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous GraphsDasol Hwang, Jinyoung Park, Sunyoung Kwon, Kyung-Min Kim et al.NeurIPS 2020 · 84 citations
- Reserving-Masking-Reconstruction Model for Self-Supervised Heterogeneous Graph RepresentationHaoran Duan, Cheng Xie, Linyu LiKDD 2024 · 9 citations
- Auto-HeG: Automated Graph Neural Network on Heterophilic GraphsXin Zheng, Miao Zhang, Chunyang Chen, Qin Zhang et al.WWW 2023 · 46 citations
