Dual Space Graph Contrastive Learning
Haoran Yang, Hongxu Chen, Shirui Pan, Lin Li, Philip S. Yu, Guandong Xu
Abstract
Unsupervised graph representation learning has emerged as a powerful tool to address real-world problems and achieves huge success in the graph learning domain. Graph contrastive learning is one of the unsupervised graph representation learning methods, which recently attracts attention from researchers and has achieved stateof-the-art performances on various tasks. The key to the success of graph contrastive learning is to construct proper contrasting pairs to acquire the underlying structural semantics of the graph. However, this key part is not fully explored currently, most of the ways generating contrasting pairs focus on augmenting or perturbating graph structures to obtain different views of the input graph. But such strategies could degrade the performances via adding noise into the graph, which may narrow down the field of the applications of graph contrastive learning. In this paper, we propose a novel graph contrastive learning method, namely Dual Space Graph Contrastive (DSGC) Learning, to conduct graph contrastive learning among views generated in different spaces including the hyperbolic space and the Euclidean space. Since both spaces have their own advantages to represent graph data in the embedding spaces, we hope to utilize graph contrastive learning to bridge the spaces and leverage advantages from both sides. The comparison experiment results show that DSGC achieves competitive or better performances among all the datasets. In addition, we conduct extensive experiments to analyze the impact of different graph encoders on DSGC, giving insights about how to better leverage the advantages of contrastive learning between different spaces. CCS CONCEPTS • Computing methodologies → Semantic networks; Unsupervised learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- GraphGPT: Graph Instruction Tuning for Large Language ModelsJiabin Tang, Yuhao Yang, Wei Wei, Lei Shi et al.SIGIR 2024 · 182 citations
- Neighbor Contrastive Learning on Learnable Graph AugmentationXiao Shen, Dewang Sun, Shirui Pan, Xi Zhou et al.AAAI 2023 · 144 citations
- CoCo: A Coupled Contrastive Framework for Unsupervised Domain Adaptive Graph ClassificationNan Yin, Li Shen, Mengzhu Wang, Long Lan et al.ICML 2023 · 62 citations
- KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph CompletionZhaoxuan Tan, Zilong Chen, Shangbin Feng, Qingyue Zhang et al.WWW 2023 · 50 citations
- Self-Supervised Continual Graph Learning in Adaptive Riemannian SpacesLi Sun, Junda Ye, Hao Peng, Feiyang Wang et al.AAAI 2023 · 49 citations
Builds on6
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- GCC: Graph Contrastive Coding for Graph Neural Network Pre-TrainingJiezhong Qiu, Qibin Chen, Yuxiao Dong, Jing Zhang et al.KDD 2020 · 755 citations
- Graph Representation Learning via Graphical Mutual Information MaximizationZhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng et al.WWW 2020 · 682 citations
Related papers
- Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive LearningYifei Zhang, Hao Zhu, Menglin Yang, Jiahong Liu et al.KDD 2025 · 4 citations
- I'm Me, We're Us, and I'm Us: Tri-directional Contrastive Learning on HypergraphsDongjin Lee, Kijung ShinAAAI 2023 · 69 citations
- AutoGCL: Automated Graph Contrastive Learning via Learnable View GeneratorsYihang Yin, Qingzhong Wang, Siyu Huang, Haoyi Xiong et al.AAAI 2022 · 203 citations
- Adversarial Graph Contrastive Learning with Information RegularizationShengyu Feng, Baoyu Jing, Yada Zhu, Hanghang TongWWW 2022 · 76 citations
- Generating Counterfactual Hard Negative Samples for Graph Contrastive LearningHaoran Yang, Hongxu Chen, Sixiao Zhang, Xiangguo Sun et al.WWW 2023 · 36 citations
