Self-Supervised Heterogeneous Graph Learning: a Homophily and Heterogeneity View
Yujie Mo, Feiping Nie, Ping Hu, Heng Tao Shen, Zheng Zhang, Xinchao Wang, Xiaofeng Zhu
摘要
Self-supervised heterogeneous graph learning has achieved promising results in various real applications, but it still suffers from the following issues: (i) metapaths can be employed to capture the homophily in the heterogeneous graph, but meta-paths are human-defined, requiring substantial expert knowledge and computational costs; and (ii) the heterogeneity in the heterogeneous graph is usually underutilized, leading to the loss of task-related information. To solve these issues, this paper proposes to capture both homophily and heterogeneity in the heterogeneous graph without pre-defined meta-paths. Specifically, we propose to learn a self-expressive matrix to capture the homophily from the subspace and nearby neighbors. Meanwhile, we propose to capture the heterogeneity by aggregating the information of nodes from different types. We further design a consistency loss and a specificity loss, respectively, to extract the consistent information between homophily and heterogeneity and to preserve their specific task-related information.
We theoretically analyze that the learned homophilous representations exhibit the grouping effect to capture the homophily, and considering both homophily and heterogeneity introduces more task-related information. Extensive experimental results verify the superiority of the proposed method on different downstream tasks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper9
- Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering PerspectiveYujie Mo, Zhihe Lu, Runpeng Yu, Xiaofeng Zhu 等NeurIPS 2024 · 被引用 15 次
- GraphLearner: Graph Node Clustering with Fully Learnable AugmentationXihong Yang, Erxue Min, Ke Liang, Yue Liu 等ACM MM 2024 · 被引用 14 次
- Multiplex Graph Representation Learning with Homophily and ConsistencyYudi Huang, Ci Nie, Hongqing He, Yujie Mo 等AAAI 2025 · 被引用 3 次
- MUG: Meta-path-aware Universal Heterogeneous Graph Pre-TrainingLianze Shan, Jitao Zhao, Dongxiao He, Yongqi Huang 等AAAI 2026 · 被引用 1 次
- Enhancing Homophily-Heterophily Separation: Relation-Aware Learning in Heterogeneous GraphsZiyu Zheng, Yaming Yang, Ziyu Guan, Wei Zhao 等KDD 2025 · 被引用 1 次
它引用的顶会 Paper27
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel 等ICLR 2020 · 被引用 7,418 次
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun 等ICML 2021 · 被引用 2,942 次
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 被引用 1,663 次
相关 Paper
- Enhancing Homophily in Heterogeneous Graph Contrastive Learning via Connection Strength and Multi-view Self-ExpressionHaosen Wang, Chenglong Shi, Can Xu, Surong Yan 等SIGIR 2025 · 被引用 1 次
- Automated Self-Supervised Learning for GraphsWei Jin, Xiaorui Liu, Xiangyu Zhao, Yao Ma 等ICLR 2022 · 被引用 95 次
- Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous GraphsDasol Hwang, Jinyoung Park, Sunyoung Kwon, Kyung-Min Kim 等NeurIPS 2020 · 被引用 84 次
- Reserving-Masking-Reconstruction Model for Self-Supervised Heterogeneous Graph RepresentationHaoran Duan, Cheng Xie, Linyu LiKDD 2024 · 被引用 9 次
- Auto-HeG: Automated Graph Neural Network on Heterophilic GraphsXin Zheng, Miao Zhang, Chunyang Chen, Qin Zhang 等WWW 2023 · 被引用 46 次
