Game-theoretic Counterfactual Explanation for Graph Neural Networks
Chirag Chhablani, Sarthak Jain, Akshay Channesh, Ian A. Kash, Sourav Medya
Abstract
Graph Neural Networks (GNNs) have been a powerful tool for node classification tasks in complex networks. However, their decision-making processes remain a black-box to users, making it challenging to understand the reasoning behind their predictions. Counterfactual explanations (CFE) have shown promise in enhancing the interpretability of machine learning models. Prior approaches to compute CFE for GNNS often are learning-based approaches that require training additional graphs. In this paper, we propose a semivalue-based, non-learning approach to generate CFE for node classification tasks, eliminating the need for any additional training. Our results reveals that computing Banzhaf values requires lower sample complexity in identifying the counterfactual explanations compared to other popular methods such as computing Shapley values. Our empirical evidence indicates computing Banzhaf values can achieve up to a fourfold speed up compared to Shapley values. We also design a thresholding method for computing Banzhaf values and show theoretical and empirical results on its robustness in noisy environments, making it superior to Shapley values. Furthermore, the thresholded Banzhaf values are shown to enhance efficiency without compromising the quality (i.e., fidelity) in the explanations in three popular graph datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- GraphTrail: Translating GNN Predictions into Human-Interpretable Logical RulesBurouj Armgaan, Manthan Dalmia, Sourav Medya, Sayan RanuNeurIPS 2024 · 28 citations
- From Nodes to Narratives: Explaining Graph Neural Networks with LLMs and Graph ContextPeyman Baghershahi, Gregoire Fournier, Pranav Nyati, Sourav MedyaACL 2026 · 9 citations
- ATEX-CF: Attack-Informed Counterfactual Explanations for Graph Neural NetworksYu Zhang, Sean Bin Yang, Arijit Khan, Cuneyt Gurcan AkcoraICLR 2026 · 4 citations
- COMRECGC: Global Graph Counterfactual Explainer through Common RecourseGregoire Fournier, Sourav MedyaICML 2025
- CausalSKyHop: Knowledge-Aware Causal Explanation of Dynamic GNNs via Higher-Order Semantic ReasoningJixuan Wu, Limei Lin, Xiaoding Wang, Kunpeng Xu et al.WWW 2026
Builds on18
- Parameterized Explainer for Graph Neural NetworkDongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu et al.NeurIPS 2020 · 888 citations
- Problems with Shapley-value-based explanations as feature importance measuresI. Elizabeth Kumar, Suresh Venkatasubramanian, Carlos Scheidegger, Sorelle A. FriedlerICML 2020 · 458 citations
- Interpreting Graph Neural Networks for NLP With Differentiable Edge MaskingMichael Sejr Schlichtkrull, Nicola De Cao, Ivan TitovICLR 2021 · 287 citations
- Generative Causal Explanations for Graph Neural NetworksWanyu Lin, Hao Lan, Baochun LiICML 2021 · 217 citations
- Robust Counterfactual Explanations on Graph Neural NetworksMohit Bajaj, Lingyang Chu, Zi Yu Xue, Jian Pei et al.NeurIPS 2021 · 140 citations
Related papers
- GNNShap: Scalable and Accurate GNN Explanation using Shapley ValuesSelahattin Akkas, Ariful AzadWWW 2024 · 31 citations
- On Explainability of Graph Neural Networks via Subgraph ExplorationsHao Yuan, Haiyang Yu, Jie Wang, Kang Li et al.ICML 2021 · 498 citations
- GStarX: Explaining Graph Neural Networks with Structure-Aware Cooperative GamesShichang Zhang, Yozen Liu, Neil Shah, Yizhou SunNeurIPS 2022 · 79 citations
- Learning and Evaluating Graph Neural Network Explanations based on Counterfactual and Factual ReasoningJuntao Tan, Shijie Geng, Zuohui Fu, Yingqiang Ge et al.WWW 2022 · 151 citations
- DEGREE: Decomposition Based Explanation for Graph Neural NetworksQizhang Feng, Ninghao Liu, Fan Yang, Ruixiang Tang et al.ICLR 2022 · 33 citations
