SEGA: Structural Entropy Guided Anchor View for Graph Contrastive Learning
Junran Wu, Xueyuan Chen, Bowen Shi, Shangzhe Li, Ke Xu
Abstract
In contrastive learning, the choice of ``view'' controls the information that the representation captures and influences the performance of the model. However, leading graph contrastive learning methods generally produce views via random corruption or learning, which could lead to the loss of essential information and alteration of semantic information. An anchor view that maintains the essential information of input graphs for contrastive learning has been hardly investigated. In this paper, based on the theory of graph information bottleneck, we deduce the definition of this anchor view; put differently, the anchor view with essential information of input graph is supposed to have the minimal structural uncertainty. Furthermore, guided by structural entropy, we implement the anchor view, termed SEGA, for graph contrastive learning. We extensively validate the proposed anchor view on various benchmarks regarding graph classification under unsupervised, semi-supervised, and transfer learning and achieve significant performance boosts compared to the state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers16
- LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph ClusteringLi Sun, Zhenhao Huang, Hao Peng, Yujie Wang et al.ICML 2024 · 31 citations
- SEBot: Structural Entropy Guided Multi-View Contrastive learning for Social Bot DetectionYingguang Yang, Qi Wu, Buyun He, Hao Peng et al.KDD 2024 · 25 citations
- Structural Entropy Based Graph Structure Learning for Node ClassificationLiang Duan, Xiang Chen, Wenjie Liu, Daliang Liu et al.AAAI 2024 · 24 citations
- Unified Graph Augmentations for Generalized Contrastive Learning on GraphsJiaming Zhuo, Yintong Lu, Hui Ning, Kun Fu et al.NeurIPS 2024 · 19 citations
- HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text ClassificationHe Zhu, Chong Zhang, Junjie Huang, Junran Wu et al.ACL 2023 · 17 citations
Builds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- What Makes for Good Views for Contrastive Learning?Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan et al.NeurIPS 2020 · 1,631 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
Related papers
- InfoGCL: Information-Aware Graph Contrastive LearningDongkuan Xu, Wei Cheng, Dongsheng Luo, Haifeng Chen et al.NeurIPS 2021 · 261 citations
- Structural Entropy Guided Unsupervised Graph Out-Of-Distribution DetectionYue Hou, He Zhu, Ruomei Liu, Yingke Su et al.AAAI 2025 · 6 citations
- Uncovering Capabilities of Model Pruning in Graph Contrastive LearningJunran Wu, Xueyuan Chen, Shangzhe LiACM MM 2024 · 2 citations
- AutoGCL: Automated Graph Contrastive Learning via Learnable View GeneratorsYihang Yin, Qingzhong Wang, Siyu Huang, Haoyi Xiong et al.AAAI 2022 · 203 citations
- SGCL: Semantic-aware Graph Contrastive Learning with Lipschitz Graph AugmentationJinhao Cui, Heyan Chai, Xu Yang, Ye Ding et al.ICDE 2024 · 1 citation
