SEGA: Structural Entropy Guided Anchor View for Graph Contrastive Learning
Junran Wu, Xueyuan Chen, Bowen Shi, Shangzhe Li, Ke Xu
摘要
In contrastive learning, the choice of ``view'' controls the information that the representation captures and influences the performance of the model. However, leading graph contrastive learning methods generally produce views via random corruption or learning, which could lead to the loss of essential information and alteration of semantic information. An anchor view that maintains the essential information of input graphs for contrastive learning has been hardly investigated. In this paper, based on the theory of graph information bottleneck, we deduce the definition of this anchor view; put differently, the anchor view with essential information of input graph is supposed to have the minimal structural uncertainty. Furthermore, guided by structural entropy, we implement the anchor view, termed SEGA, for graph contrastive learning. We extensively validate the proposed anchor view on various benchmarks regarding graph classification under unsupervised, semi-supervised, and transfer learning and achieve significant performance boosts compared to the state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper16
- LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph ClusteringLi Sun, Zhenhao Huang, Hao Peng, Yujie Wang 等ICML 2024 · 被引用 31 次
- SEBot: Structural Entropy Guided Multi-View Contrastive learning for Social Bot DetectionYingguang Yang, Qi Wu, Buyun He, Hao Peng 等KDD 2024 · 被引用 25 次
- Structural Entropy Based Graph Structure Learning for Node ClassificationLiang Duan, Xiang Chen, Wenjie Liu, Daliang Liu 等AAAI 2024 · 被引用 24 次
- Unified Graph Augmentations for Generalized Contrastive Learning on GraphsJiaming Zhuo, Yintong Lu, Hui Ning, Kun Fu 等NeurIPS 2024 · 被引用 19 次
- HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text ClassificationHe Zhu, Chong Zhang, Junjie Huang, Junran Wu 等ACL 2023 · 被引用 17 次
它引用的顶会 Paper15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik 等ICLR 2020 · 被引用 1,744 次
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 被引用 1,663 次
- What Makes for Good Views for Contrastive Learning?Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan 等NeurIPS 2020 · 被引用 1,631 次
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 被引用 1,010 次
相关 Paper
- InfoGCL: Information-Aware Graph Contrastive LearningDongkuan Xu, Wei Cheng, Dongsheng Luo, Haifeng Chen 等NeurIPS 2021 · 被引用 261 次
- Structural Entropy Guided Unsupervised Graph Out-Of-Distribution DetectionYue Hou, He Zhu, Ruomei Liu, Yingke Su 等AAAI 2025 · 被引用 6 次
- Uncovering Capabilities of Model Pruning in Graph Contrastive LearningJunran Wu, Xueyuan Chen, Shangzhe LiACM MM 2024 · 被引用 2 次
- AutoGCL: Automated Graph Contrastive Learning via Learnable View GeneratorsYihang Yin, Qingzhong Wang, Siyu Huang, Haoyi Xiong 等AAAI 2022 · 被引用 203 次
- SGCL: Semantic-aware Graph Contrastive Learning with Lipschitz Graph AugmentationJinhao Cui, Heyan Chai, Xu Yang, Ye Ding 等ICDE 2024 · 被引用 1 次
