Attribute and Structure Preserving Graph Contrastive Learning
Jialu Chen, Gang Kou
Abstract
Graph Contrastive Learning (GCL) has drawn much research interest due to its strong ability to capture both graph structure and node attribute information in a self-supervised manner. Current GCL methods usually adopt Graph Neural Networks (GNNs) as the base encoder, which typically relies on the homophily assumption of networks and overlooks node similarity in the attribute space. There are many scenarios where such assumption cannot be satisfied, or node similarity plays a crucial role. In order to design a more robust mechanism, we develop a novel attribute and structure preserving graph contrastive learning framework, named ASP, which comprehensively and efficiently preserves node attributes while exploiting graph structure. Specifically, we consider three different graph views in our framework, i.e., original view, attribute view, and global structure view. Then, we perform contrastive learning across three views in a joint fashion, mining comprehensive graph information. We validate the effectiveness of the proposed framework on various real-world networks with different levels of homophily. The results demonstrate the superior performance of our model over the representative baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Substructure Aware Graph Neural NetworksDingyi Zeng, Wanlong Liu, Wenyu Chen, Li Zhou et al.AAAI 2023 · 60 citations
- Leveraging Contrastive Learning for Enhanced Node Representations in Tokenized Graph TransformersJinsong Chen, Hanpeng Liu, John E. Hopcroft, Kun HeNeurIPS 2024 · 23 citations
- Cluster-guided Contrastive Class-imbalanced Graph ClassificationWei Ju, Zhengyang Mao, Siyu Yi, Yifang Qin et al.AAAI 2025 · 6 citations
- Beyond Homophily: Graph Contrastive Learning with Macro-Micro Message PassingYiyuan Chen, Donghai Guan, Weiwei Yuan, Tianzi ZangAAAI 2025 · 5 citations
- Unsupervised Contrastive Learning for Efficient and Robust Spectral Shape MatchingFeifan Luo, Hongyang ChenAAAI 2026
Builds on18
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- What Makes for Good Views for Contrastive Learning?Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan et al.NeurIPS 2020 · 1,631 citations
Related papers
- Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive LearningKaize Ding, Yancheng Wang, Yingzhen Yang, Huan LiuAAAI 2023 · 32 citations
- Graph Contrastive Learning via Interventional View GenerationZengyi Wo, Minglai Shao, Wenjun Wang, Xuan Guo et al.WWW 2024 · 13 citations
- AutoGCL: Automated Graph Contrastive Learning via Learnable View GeneratorsYihang Yin, Qingzhong Wang, Siyu Huang, Haoyi Xiong et al.AAAI 2022 · 203 citations
- ArnoldiGCL: Graph Contrastive Learning via Learnable Arnoldi-Based Guided Spectral Chebyshev Polynomial FiltersMustafa Coskun, Abdelkader Baggag, Mehmet KoyutürkKDD 2025
- Simple and Asymmetric Graph Contrastive Learning without AugmentationsTeng Xiao, Huaisheng Zhu, Zhengyu Chen, Suhang WangNeurIPS 2023 · 86 citations
