Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressiveness
Bohang Zhang, Jingchu Gai, Yiheng Du, Qiwei Ye, Di He, Liwei Wang
摘要
Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure has notable limitations: it is inherently coarse, qualitative, and may not well reflect practical requirements (e.g., the ability to encode substructures). In this paper, we introduce a unified framework for quantitatively studying the expressiveness of GNN architectures, addressing all the above limitations. Specifically, we identify a fundamental expressivity measure termed homomorphism expressivity, which quantifies the ability of GNN models to count graphs under homomorphism. Homomorphism expressivity offers a complete and practical assessment tool: the completeness enables direct expressivity comparisons between GNN models, while the practicality allows for understanding concrete GNN abilities such as subgraph counting. By examining four classes of prominent GNNs as case studies, we derive simple, unified, and elegant descriptions of their homomorphism expressivity for both invariant and equivariant settings. Our results provide novel insights into a series of previous work, unify the landscape of different subareas in the community, and settle several open questions. Empirically, extensive experiments on both synthetic and real-world tasks verify our theory, showing that the practical performance of GNN models aligns well with the proposed metric. * Equal technical contributions. † Project lead.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper29
- GFT: Graph Foundation Model with Transferable Tree VocabularyZehong Wang, Zheyuan Zhang, Nitesh V. Chawla, Chuxu Zhang 等NeurIPS 2024 · 被引用 108 次
- A Canonicalization Perspective on Invariant and Equivariant LearningGeorge Ma, Yifei Wang, Derek Lim, Stefanie Jegelka 等NeurIPS 2024 · 被引用 38 次
- An Empirical Study of Realized GNN ExpressivenessYanbo Wang, Muhan ZhangICML 2024 · 被引用 29 次
- Homomorphism Counts for Graph Neural Networks: All About That BasisEmily Jin, Michael M. Bronstein, Ismail Ilkan Ceylan, Matthias LanzingerICML 2024 · 被引用 23 次
- Generalization Performance of Hypergraph Neural NetworksYifan Wang, Gonzalo R. Arce, Guangmo TongWWW 2025 · 被引用 6 次
它引用的顶会 Paper46
- Do Transformers Really Perform Badly for Graph Representation?Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng 等NeurIPS 2021 · 被引用 1,632 次
- Recipe for a General, Powerful, Scalable Graph TransformerLadislav Rampásek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu 等NeurIPS 2022 · 被引用 1,216 次
- Principal Neighbourhood Aggregation for Graph NetsGabriele Corso, Luca Cavalleri, Dominique Beaini, Pietro Liò 等NeurIPS 2020 · 被引用 914 次
- Rethinking Graph Transformers with Spectral AttentionDevin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau 等NeurIPS 2021 · 被引用 854 次
- Graph Neural Networks with Learnable Structural and Positional RepresentationsVijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio 等ICLR 2022 · 被引用 464 次
相关 Paper
- Towards a Complete Logical Framework for GNN ExpressivenessTuo XuICLR 2025
- 𝒩-WL: A New Hierarchy of Expressivity for Graph Neural NetworksQing Wang, Dillon Ze Chen, Asiri Wijesinghe, Shouheng Li 等ICLR 2023
- Equivariant Polynomials for Graph Neural NetworksOmri Puny, Derek Lim, Bobak Toussi Kiani, Haggai Maron 等ICML 2023 · 被引用 41 次
- Homomorphism Expressivity of Spectral Invariant Graph Neural NetworksJingchu Gai, Yiheng Du, Bohang Zhang, Haggai Maron 等ICLR 2025
- A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman TestsBohang Zhang, Guhao Feng, Yiheng Du, Di He 等ICML 2023 · 被引用 84 次
