Contrastive Auxiliary Learning with Structure Transformation for Heterogeneous Graphs
Wei Du, Hongmin Sun, Hang Gao, Gaoyang Li, Ying Li
Abstract
In recent years, methods based on heterogeneous graph neural networks (HGNNs) have been widely used for embedding heterogeneous graphs (HGs) due to their ability to effectively encode the rich information from HGs into low-dimensional node embeddings. Existing HGNNs focus on neighbor aggregation and semantic fusion while neglecting the HG structure and learning paradigms. However, the original data in the HG might lack node features, which may not be effectively accounted for by existing models. Additionally, exclusively relying on a single supervised learning approach may only partially leverage the invariant information in graph data. To address these challenges, we introduce the Contrastive Auxiliary Learning Model for Heterogeneous Graphs (CALHG), which combines edge perturbation and graph diffusion to enhance graph data, allowing it to capture the inherent structural information within heterogeneous graphs fully. Additionally, we employ a category-guided multi-view contrastive learning optimizing strategy, which does not rely on positive and negative samples for model training, enabling us to capture the intrinsic invariances in heterogeneous graph data. Extensive experiments and analyses on five benchmark datasets without node features and three benchmark datasets with node features validate the effectiveness and efficiency of our novel method compared with several state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0fd3e334-71a9-4b87-ad74-61bf2996bd01Cited by top-tier papers1
Ask how each one uses itBuilds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun et al.ICML 2021 · 2,942 citations
- VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised LearningAdrien Bardes, Jean Ponce, Yann LeCunICLR 2022 · 1,226 citations
- MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph EmbeddingXinyu Fu, Jiani Zhang, Ziqiao Meng, Irwin KingWWW 2020 · 1,149 citations
Related papers
- Self-supervised Heterogeneous Graph Neural Network with Co-contrastive LearningXiao Wang, Nian Liu, Hui Han, Chuan ShiKDD 2021 · 388 citations
- Multi-view Hierarchical Graph Contrastive Learning based on Asynchronous Asymmetric StructureChuangui Cao, Shifei Ding, Jian Zhang, Lili Guo et al.WWW 2026
- Multi-View Graph Clustering via Node-Guided Contrastive EncodingYazhou Ren, Junlong Ke, Zichen Wen, Tianyi Wu et al.ICML 2025
- Label-invariant Augmentation for Semi-Supervised Graph ClassificationHan Yue, Chunhui Zhang, Chuxu Zhang, Hongfu LiuNeurIPS 2022 · 37 citations
- HGOT: Self-supervised Heterogeneous Graph Neural Network with Optimal TransportYanbei Liu, Chongxu Wang, Zhitao Xiao, Lei Geng et al.ICML 2025
