Global Explainability of GNNs via Logic Combination of Learned Concepts
Steve Azzolin, Antonio Longa, Pietro Barbiero, Pietro Liò, Andrea Passerini
Abstract
While instance-level explanation of GNN is a well-studied problem with plenty of approaches being developed, providing a global explanation for the behaviour of a GNN is much less explored, despite its potential in interpretability and debugging. Existing solutions either simply list local explanations for a given class, or generate a synthetic prototypical graph with maximal score for a given class, completely missing any combinatorial aspect that the GNN could have learned. In this work, we propose GLGExplainer (Global Logic-based GNN Explainer), the first Global Explainer capable of generating explanations as arbitrary Boolean combinations of learned graphical concepts. GLGExplainer is a fully differentiable architecture that takes local explanations as inputs and combines them into a logic formula over graphical concepts, represented as clusters of local explanations. Contrary to existing solutions, GLGExplainer provides accurate and human-interpretable global explanations that are perfectly aligned with ground-truth explanations (on synthetic data) or match existing domain knowledge (on real-world data). Extracted formulas are faithful to the model predictions, to the point of providing insights into some occasionally incorrect rules learned by the model, making GLGExplainer a promising diagnostic tool for learned GNNs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 549d285c-9191-4686-8810-7a0e77138ec1Cited by top-tier papers26
- Interpretable Neural-Symbolic Concept ReasoningPietro Barbiero, Gabriele Ciravegna, Francesco Giannini, Mateo Espinosa Zarlenga et al.ICML 2023 · 68 citations
- GraphTrail: Translating GNN Predictions into Human-Interpretable Logical RulesBurouj Armgaan, Manthan Dalmia, Sourav Medya, Sayan RanuNeurIPS 2024 · 28 citations
- GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth BenchmarkingMert Kosan, Samidha Verma, Burouj Armgaan, Khushbu Pahwa et al.ICLR 2024 · 21 citations
- Towards Robust Fidelity for Evaluating Explainability of Graph Neural NetworksXu Zheng, Farhad Shirani, Tianchun Wang, Wei Cheng et al.ICLR 2024 · 17 citations
- Factorized Explainer for Graph Neural NetworksRundong Huang, Farhad Shirani, Dongsheng LuoAAAI 2024 · 16 citations
Builds on11
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 1,717 citations
- Concept Bottleneck ModelsPang Wei Koh, Thao Nguyen, Yew Siang Tang, Stephen Mussmann et al.ICML 2020 · 1,233 citations
- Parameterized Explainer for Graph Neural NetworkDongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu et al.NeurIPS 2020 · 888 citations
- On Explainability of Graph Neural Networks via Subgraph ExplorationsHao Yuan, Haiyang Yu, Jie Wang, Kang Li et al.ICML 2021 · 498 citations
- PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural NetworksMinh N. Vu, My T. ThaiNeurIPS 2020 · 437 citations
Related papers
- GnnXemplar: Exemplars to Explanations - Natural Language Rules for Global GNN InterpretabilityBurouj Armgaan, Eshan Jain, Harsh Pandey, Mahesh Chandran et al.NeurIPS 2025 · 5 citations
- Global Concept-Based Interpretability for Graph Neural Networks via Neuron AnalysisHan Xuanyuan, Pietro Barbiero, Dobrik Georgiev, Lucie Charlotte Magister et al.AAAI 2023 · 62 citations
- Explaining GNN Explanations with Edge GradientsJesse He, Akbar Rafiey, Gal Mishne, Yusu WangKDD 2025 · 2 citations
- Reinforcement Learning Enhanced Explainer for Graph Neural NetworksCaihua Shan, Yifei Shen, Yao Zhang, Xiang Li et al.NeurIPS 2021 · 81 citations
- ProtGNN: Towards Self-Explaining Graph Neural NetworksZaixi Zhang, Qi Liu, Hao Wang, Chengqiang Lu et al.AAAI 2022 · 173 citations
