Path Integral Based Convolution and Pooling for Graph Neural Networks
Zheng Ma, Junyu Xuan, Yu Guang Wang, Ming Li, Pietro Liò
Abstract
Graph neural networks (GNNs) extends the functionality of traditional neural networks to graph-structured data. Similar to CNNs, an optimized design of graph convolution and pooling is key to success. Borrowing ideas from physics, we propose a path integral based graph neural networks (PAN) for classification and regression tasks on graphs. Specifically, we consider a convolution operation that involves every path linking the message sender and receiver with learnable weights depending on the path length, which corresponds to the maximal entropy random walk. It generalizes the graph Laplacian to a new transition matrix we call maximal entropy transition (MET) matrix derived from a path integral formalism. Importantly, the diagonal entries of the MET matrix are directly related to the subgraph centrality, thus providing a natural and adaptive pooling mechanism. PAN provides a versatile framework that can be tailored for different graph data with varying sizes and structures. We can view most existing GNN architectures as special cases of PAN. Experimental results show that PAN achieves state-of-theart performance on various graph classification/regression tasks, including a new benchmark dataset from statistical mechanics we propose to boost applications of GNN in physical sciences. Preprint. Under review.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and TopologyFrancesco Di Giovanni, Lorenzo Giusti, Federico Barbero, Giulia Luise et al.ICML 2023 · 190 citations
- How Framelets Enhance Graph Neural NetworksXuebin Zheng, Bingxin Zhou, Junbin Gao, Yuguang Wang et al.ICML 2021 · 83 citations
- Locality-Aware Graph Rewiring in GNNsFederico Barbero, Ameya Velingker, Amin Saberi, Michael M. Bronstein et al.ICLR 2024 · 64 citations
- High-level synthesis performance prediction using GNNs: benchmarking, modeling, and advancingNan Wu, Hang Yang, Yuan Xie, Pan Li et al.DAC 2022 · 57 citations
- The expressive power of pooling in Graph Neural NetworksFilippo Maria Bianchi, Veronica LachiNeurIPS 2023 · 55 citations
Builds on4
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph RepresentationsEkagra Ranjan, Soumya Sanyal, Partha P. TalukdarAAAI 2020 · 400 citations
- StructPool: Structured Graph Pooling via Conditional Random FieldsHao Yuan, Shuiwang JiICLR 2020 · 204 citations
- Haar Graph PoolingYuguang Wang, Ming Li, Zheng Ma, Guido Montúfar et al.ICML 2020 · 86 citations
Related papers
- Path Neural Networks: Expressive and Accurate Graph Neural NetworksGaspard Michel, Giannis Nikolentzos, Johannes F. Lutzeyer, Michalis VazirgiannisICML 2023 · 45 citations
- Neural Link Prediction with Walk PoolingLiming Pan, Cheng Shi, Ivan DokmanicICLR 2022 · 66 citations
- MagNet: A Neural Network for Directed GraphsXitong Zhang, Yixuan He, Nathan Brugnone, Michael Perlmutter et al.NeurIPS 2021 · 223 citations
- pathGCN: Learning General Graph Spatial Operators from PathsMoshe Eliasof, Eldad Haber, Eran TreisterICML 2022 · 33 citations
- Memory-Based Graph NetworksAmir Hosein Khas Ahmadi, Kaveh Hassani, Parsa Moradi, Leo Lee et al.ICLR 2020 · 100 citations
