Enhancing Graph Contrastive Learning for Protein Graphs from Perspective of Invariance
Yusong Wang, Shiyin Tan, Jialun Shen, Yicheng Xu, Haobo Song, Qi Xu, Prayag Tiwari, Mingkun Xu
Abstract
Graph Contrastive Learning (GCL) improves Graph Neural Network (GNN)-based protein representation learning by enhancing its generalization and robustness. Existing GCL approaches for protein representation learning rely on 2D topology, where graph augmentation is solely based on topological features, ignoring the intrinsic biological properties of proteins. Besides, 3D structure-based protein graph augmentation remains unexplored, despite proteins inherently exhibiting 3D structures. To bridge this gap, we propose novel biology-aware graph augmentation strategies from the perspective of invariance and integrate them into the protein GCL framework. Specifically, we introduce Functional Community Invariance (FCI)-based graph augmentation, which employs spectral constraints to preserve topology-driven community structures while incorporating residue-level chemical similarity as edge weights to guide edge sampling and maintain functional communities. Furthermore, we propose 3D Protein Structure Invariance (3-PSI)based graph augmentation, leveraging dihedral angle perturbations and secondary structure rotations to retain critical 3D structural information of proteins while diversifying graph views. Extensive experiments on four different protein-related tasks demonstrate the superiority of our proposed GCL protein representation learning framework.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Greater than the Sum of Its Parts: Building Substructure into Protein Encoding ModelsRobert Calef, Arthur Liang, Manolis Kellis, Marinka ZitnikICLR 2026 · 2 citations
- MMPG: MoE-based Adaptive Multi-Perspective Graph Fusion for Protein Representation LearningYusong Wang, Jialun Shen, Zhihao Wu, Yicheng Xu et al.AAAI 2026
Builds on21
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Learning from Protein Structure with Geometric Vector PerceptronsBowen Jing, Stephan Eismann, Patricia Suriana, Raphael John Lamarre Townshend et al.ICLR 2021 · 627 citations
- Adversarial Graph Augmentation to Improve Graph Contrastive LearningSusheel Suresh, Pan Li, Cong Hao, Jennifer NevilleNeurIPS 2021 · 475 citations
- Pre-training Molecular Graph Representation with 3D GeometryShengchao Liu, Hanchen Wang, Weiyang Liu, Joan Lasenby et al.ICLR 2022 · 440 citations
- EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree RepresentationsYi-Lun Liao, Brandon M. Wood, Abhishek Das, Tess E. SmidtICLR 2024 · 311 citations
Related papers
- Community-Invariant Graph Contrastive LearningShiyin Tan, Dongyuan Li, Renhe Jiang, Ying Zhang et al.ICML 2024 · 16 citations
- Label-invariant Augmentation for Semi-Supervised Graph ClassificationHan Yue, Chunhui Zhang, Chuxu Zhang, Hongfu LiuNeurIPS 2022 · 37 citations
- Spectral Augmentation for Self-Supervised Learning on GraphsLu Lin, Jinghui Chen, Hongning WangICLR 2023 · 16 citations
- Revisiting Graph Contrastive Learning from the Perspective of Graph SpectrumNian Liu, Xiao Wang, Deyu Bo, Chuan Shi et al.NeurIPS 2022 · 102 citations
- GeomGCL: Geometric Graph Contrastive Learning for Molecular Property PredictionShuangli Li, Jingbo Zhou, Tong Xu, Dejing Dou et al.AAAI 2022 · 158 citations
