Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning
Sheng Wan, Shirui Pan, Jian Yang, Chen Gong
Abstract
Graph-based Semi-Supervised Learning (SSL) aims to transfer the labels of a handful of labeled data to the remaining massive unlabeled data via a graph. As one of the most popular graph-based SSL approaches, the recently proposed Graph Convolutional Networks (GCNs) have gained remarkable progress by combining the sound expressiveness of neural networks with graph structure. Nevertheless, the existing graph-based methods do not directly address the core problem of SSL, i.e., the shortage of supervision, and thus their performances are still very limited. To accommodate this issue, this paper presents a novel GCN-based SSL algorithm which aims to enrich the supervision signals by utilizing both data similarities and graph structure. Firstly, by designing a semi-supervised contrastive loss, the improved node representations can be generated via maximizing the agreement between different views of the same data or the data from the same class. Therefore, the rich unlabeled data and the scarce yet valuable labeled data can jointly provide abundant supervision information for learning discriminative node representations, which helps improve the subsequent classification result. Secondly, the underlying determinative relationship between the input graph topology and data features is extracted as supplementary supervision signals for SSL via using a graph generative loss related to input features. Intensive experimental results on a variety of real-world datasets firmly verify the effectiveness of our algorithm when compared with other state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7db656b4-45d4-4dfe-8294-de29d344ebb0Cited by top-tier papers14
- Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group DiscriminationYizhen Zheng, Shirui Pan, Vincent C. S. Lee, Yu Zheng et al.NeurIPS 2022 · 153 citations
- Contrastive Graph Poisson Networks: Semi-Supervised Learning with Extremely Limited LabelsSheng Wan, Yibing Zhan, Liu Liu, Baosheng Yu et al.NeurIPS 2021 · 71 citations
- Universal Semi-Supervised LearningZhuo Huang, Chao Xue, Bo Han, Jian Yang et al.NeurIPS 2021 · 62 citations
- A Self-Supervised Mixed-Curvature Graph Neural NetworkLi Sun, Zhongbao Zhang, Junda Ye, Hao Peng et al.AAAI 2022 · 46 citations
- Hypergraph-enhanced Dual Semi-supervised Graph ClassificationWei Ju, Zhengyang Mao, Siyu Yi, Yifang Qin et al.ICML 2024 · 39 citations
Builds on7
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Graph Representation Learning via Graphical Mutual Information MaximizationZhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng et al.WWW 2020 · 682 citations
- On Mutual Information Maximization for Representation LearningMichael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly et al.ICLR 2020 · 559 citations
- Poisson Learning: Graph Based Semi-Supervised Learning At Very Low Label RatesJeff Calder, Brendan Cook, Matthew Thorpe, Dejan SlepcevICML 2020 · 101 citations
Related papers
- Harmonic Neural NetworksAtiyo Ghosh, Antonio Andrea Gentile, Mario Dagrada, Chul Lee et al.ICML 2023 · 37 citations
- CoCoS: Enhancing Semi-supervised Learning on Graphs with Unlabeled Data via Contrastive Context SharingSiyue Xie, Da Sun Handason Tam, Wing Cheong LauAAAI 2022 · 8 citations
- SelfSAGCN: Self-Supervised Semantic Alignment for Graph Convolution NetworkXu Yang, Cheng Deng, Zhiyuan Dang, Kun Wei et al.CVPR 2021
- Self-supervised Consensus Representation Learning for Attributed GraphChangshu Liu, Liangjian Wen, Zhao Kang, Guangchun Luo et al.ACM MM 2021 · 49 citations
- Graph Contrastive Learning with Generative Adversarial NetworkCheng Wu, Chaokun Wang, Jingcao Xu, Ziyang Liu et al.KDD 2023 · 33 citations
