Self-supervised Consensus Representation Learning for Attributed Graph
Changshu Liu, Liangjian Wen, Zhao Kang, Guangchun Luo, Ling Tian
Abstract
Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus Representation Learning (SCRL) framework. In contrast to most existing works that only explore one graph, our proposed SCRL method treats graph from two perspectives: topology graph and feature graph. We argue that their embeddings should share some common information, which could serve as a supervisory signal. Specifically, we construct the feature graph of node features via k-nearest neighbour algorithm. Then graph convolutional network (GCN) encoders extract features from two graphs respectively. Self-supervised loss is designed to maximize the agreement of the embeddings of the same node in the topology graph and the feature graph. Extensive experiments on real citation networks and social networks demonstrate the superiority of our proposed SCRL over the state-of-the-art methods on semi-supervised node classification task. Meanwhile, compared with its main competitors, SCRL is rather efficient. The source code is available at https://github.com/topgunlcs98/SCRL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 28715247-0ccd-4e0c-a1ee-fb4775e36b11Cited by top-tier papers10
- Multi-view Contrastive Graph ClusteringErlin Pan, Zhao KangNeurIPS 2021 · 316 citations
- PC-Conv: Unifying Homophily and Heterophily with Two-Fold FilteringBingheng Li, Erlin Pan, Zhao KangAAAI 2024 · 67 citations
- Beyond Homophily: Reconstructing Structure for Graph-agnostic ClusteringErlin Pan, Zhao KangICML 2023 · 67 citations
- WalkLM: A Uniform Language Model Fine-tuning Framework for Attributed Graph EmbeddingYanchao Tan, Zihao Zhou, Hang Lv, Weiming Liu et al.NeurIPS 2023 · 60 citations
- Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive LearningJingcan Duan, Pei Zhang, Siwei Wang, Jingtao Hu et al.ACM MM 2023 · 24 citations
Builds on6
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- AM-GCN: Adaptive Multi-channel Graph Convolutional NetworksXiao Wang, Meiqi Zhu, Deyu Bo, Peng Cui et al.KDD 2020 · 464 citations
- Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labeled NodesKe Sun, Zhouchen Lin, Zhanxing ZhuAAAI 2020 · 304 citations
- Towards Clustering-friendly Representations: Subspace Clustering via Graph FilteringZhengrui Ma, Zhao Kang, Guangchun Luo, Ling Tian et al.ACM MM 2020 · 54 citations
Related papers
- Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised LearningSheng Wan, Shirui Pan, Jian Yang, Chen GongAAAI 2021 · 162 citations
- Conditional Distribution Learning for Graph ClassificationJie Chen, Hua Mao, Chuanbin Liu, Zhu Wang et al.AAAI 2026
- SelfSAGCN: Self-Supervised Semantic Alignment for Graph Convolution NetworkXu Yang, Cheng Deng, Zhiyuan Dang, Kun Wei et al.CVPR 2021
- Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information MaximizationWei Dong, Junsheng Wu, Yi Luo, Zongyuan Ge et al.CVPR 2022 · 23 citations
- Enhancing the Influence of Labels on Unlabeled Nodes in Graph Convolutional NetworksJincheng Huang, Yujie Mo, Xiaoshuang Shi, Lei Feng et al.ICML 2025
