Invariant-Stratified Propagation for Expressive Graph Neural Networks
Asela Hevapathige, Ahad N. Zehmakan, Asiri Wijesinghe, Saman K. Halgamuge
Abstract
Graph Neural Networks (GNNs) face fundamental limitations in expressivity and capturing structural heterogeneity. Standard message-passing architectures are constrained by the 1-dimensional Weisfeiler-Leman (1-WL) test, unable to distinguish graphs beyond degree sequences, and aggregate information uniformly from neighbors, failing to capture how nodes occupy different structural positions within higher-order patterns. While methods exist to achieve higher expressivity, they incur prohibitive computational costs and lack unified frameworks for flexibly encoding diverse structural properties. To address these limitations, we introduce Invariant-Stratified Propagation (ISP), a framework comprising both a novel WL variant (ISP-WL) and its efficient neural network implementation (ISP-GNN). ISP stratifies nodes according to graph invariants, processing them in hierarchical strata that reveal structural distinctions invisible to 1-WL. Through hierarchical structural heterogeneity encoding, ISP quantifies differences in structural positions of nodes within higher-order patterns, distinguishing interactions between nodes with heterogeneous structural roles from those with similar structural characteristics. We provide formal theoretical analysis establishing ISP's enhanced expressivity beyond 1-WL, convergence guarantees, and inherent resistance to oversmoothing. Extensive experiments across graph classification, node classification, and influence estimation demonstrate consistent improvements of our method over both standard architectures and state-of-the-art expressive baselines. Our source code is available at: https://github.com/Aselahp/ISP-GNN.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on26
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Understanding over-squashing and bottlenecks on graphs via curvatureJake Topping, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong et al.ICLR 2022 · 628 citations
- Spectral Clustering with Graph Neural Networks for Graph PoolingFilippo Maria Bianchi, Daniele Grattarola, Cesare AlippiICML 2020 · 528 citations
- Identity-aware Graph Neural NetworksJiaxuan You, Jonathan Michael Gomes Selman, Rex Ying, Jure LeskovecAAAI 2021 · 316 citations
Related papers
- 𝒩-WL: A New Hierarchy of Expressivity for Graph Neural NetworksQing Wang, Dillon Ze Chen, Asiri Wijesinghe, Shouheng Li et al.ICLR 2023
- A New Perspective on "How Graph Neural Networks Go Beyond Weisfeiler-Lehman?"Asiri Wijesinghe, Qing WangICLR 2022 · 120 citations
- Substructure Aware Graph Neural NetworksDingyi Zeng, Wanlong Liu, Wenyu Chen, Li Zhou et al.AAAI 2023 · 60 citations
- Improving the Expressiveness of K-hop Message-Passing GNNs by Injecting Contextualized Substructure InformationTianjun Yao, Yingxu Wang, Kun Zhang, Shangsong LiangKDD 2023 · 8 citations
- Equivariant Subgraph Aggregation NetworksBeatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan et al.ICLR 2022 · 217 citations
