Learning Graph Representation via Graph Entropy Maximization
Ziheng Sun, Xudong Wang, Chris Ding, Jicong Fan
Abstract
Graph representation learning aims to represent graphs as vectors that can be utilized in downstream tasks such as graph classification. In this work, we focus on learning diverse representations that can capture the graph information as much as possible. We propose quantifying graph information using graph entropy, where we define a probability distribution of a graph based on its nodes' representations and global-graph representation. However, the computation of graph entropy is NP-hard due to the complex vertexpacking polytope involved in its definition. To address this challenge, we provide an approximation method leveraging orthonormal representations for graph entropy maximization. The proposed method is implemented via graph neural networks, resulting in informative node-level and graph-level representations. Experimental results demonstrate the effectiveness of our method in comparison to many baselines in unsupervised learning and semi-supervised learning tasks. The code of our method is available at https:// github.com/MathAdventurer/GeMax .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e87cff03-0a60-4f78-9a06-6e04c2fa0f66Cited by top-tier papers2
- Graph Classification via Reference Distribution Learning: Theory and PracticeZixiao Wang, Jicong FanNeurIPS 2024 · 18 citations
- Escaping the Homophily Trap: A Threshold-free Graph Outlier Detection Framework via Clustering-guided Edge ReweightingYunhe Zhang, Jinyu Cai, Qi Hao, Pengyang Wang et al.ICLR 2026
Builds on29
- Self-supervised Graph Learning for RecommendationJiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He et al.SIGIR 2021 · 1,476 citations
- Self-Supervised Graph Transformer on Large-Scale Molecular DataYu Rong, Yatao Bian, Tingyang Xu, Weiyang Xie et al.NeurIPS 2020 · 1,113 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
- GCC: Graph Contrastive Coding for Graph Neural Network Pre-TrainingJiezhong Qiu, Qibin Chen, Yuxiao Dong, Jing Zhang et al.KDD 2020 · 755 citations
- Graph Contrastive Learning AutomatedYuning You, Tianlong Chen, Yang Shen, Zhangyang WangICML 2021 · 604 citations
Related papers
- Graph Representation Learning via Graphical Mutual Information MaximizationZhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng et al.WWW 2020 · 682 citations
- Entropy Neural Estimation for Graph Contrastive LearningYixuan Ma, Xiaolin Zhang, Peng Zhang, Kun ZhanACM MM 2023 · 11 citations
- Rethinking the Power of Graph Canonization in Graph Representation Learning with StabilityZehao Dong, Muhan Zhang, Philip R. O. Payne, Michael A. Province et al.ICLR 2024 · 1 citation
- Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing PatternsSusheel Suresh, Vinith Budde, Jennifer Neville, Pan Li et al.KDD 2021 · 76 citations
- Lovász Principle for Unsupervised Graph Representation LearningZiheng Sun, Chris Ding, Jicong FanNeurIPS 2023 · 8 citations
