Supervised Graph Contrastive Learning for Gene Regulatory Networks
Sho Oshima, Yuji Okamoto, Taisei Tosaki, Ryosuke Kojima
Abstract
Graph Contrastive Learning (GCL) is a powerful self-supervised learning framework that performs data augmentation through graph perturbations, with growing applications in the analysis of biological networks such as Gene Regulatory Networks (GRNs). The artificial perturbations commonly used in GCL, such as node dropping, induce structural changes that can diverge from biological reality. This concern has contributed to a broader trend in graph representation learning toward augmentation-free methods, which view such structural changes as problematic and should be avoided. However, this trend overlooks the fundamental insight that structural changes from biologically meaningful perturbations are not a problem to be avoided, but rather a rich source of information, thereby ignoring the valuable opportunity to leverage data from real biological experiments. Motivated by this insight, we propose SupGCL (Supervised Graph Contrastive Learning), a new GCL method for GRNs that directly incorporates biological perturbations from gene knockdown experiments as supervision. SupGCL is a probabilistic formulation that continuously generalizes conventional GCL, linking artificial augmentations with real perturbations measured in knockdown experiments, and using the latter as explicit supervision. On patient-derived GRNs from three cancer types, we train GRN representations with SupGCL and evaluate it in two regimes: (i) embedding space analysis, where it yields clearer disease-subtype structure and improves clustering, and (ii) task-specific fine-tuning, where it consistently outperforms strong graph representation learning baselines on 13 downstream tasks spanning gene-level functional annotation and patient-level prediction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6de5aafe-6e3b-48ee-915a-9ec42984d7c4Builds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- Graph Contrastive Learning AutomatedYuning You, Tianlong Chen, Yang Shen, Zhangyang WangICML 2021 · 604 citations
- Adversarial Graph Augmentation to Improve Graph Contrastive LearningSusheel Suresh, Pan Li, Cong Hao, Jennifer NevilleNeurIPS 2021 · 475 citations
Related papers
- Boosting Graph Contrastive Learning via Graph Contrastive SaliencyChunyu Wei, Yu Wang, Bing Bai, Kai Ni et al.ICML 2023 · 31 citations
- SOLA-GCL: Subgraph-Oriented Learnable Augmentation Method for Graph Contrastive LearningTianhao Peng, Xuhong Li, Haitao Yuan, Yuchen Li et al.AAAI 2025 · 6 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Graph Contrastive Learning with Cohesive Subgraph AwarenessYucheng Wu, Leye Wang, Xiao Han, Han-Jia YeWWW 2024 · 20 citations
- GradGCL: Gradient Graph Contrastive LearningRan Li, Shimin Di, Lei Chen, Xiaofang ZhouICDE 2024 · 3 citations
