Interpretable and Parameter Efficient Graph Neural Additive Models with Random Fourier Features
Thummaluru Siddartha Reddy, Vempalli Naga Sai Saketh, Mahesh Chandran
Abstract
Graph Neural Networks (GNNs) excel at jointly modeling node features and topology, yet their black-box nature limits their adoption in real-world applications where interpretability is desired. Inspired by the success of interpretable Neural Additive Models (NAM) for tabular data, Graph Neural Additive Network (GNAN) extends the additive modeling approach to graph data to overcome limitations of GNNs. While being interpretable, GNAN representation learning overlooks the importance of local aggregation and more importantly suffers from parameter complexity. To mitigate the above challenges, we introduce Graph Neural Additive Model with Random Fourier Features ( G-NAMRFF ), a lightweight, self-interpretable graph additive architecture. G-NAMRFF represents each node embedding as the sum of feature-wise contributions where contributions are modeled via a Gaussian process (GP) with a graph-and feature-aware kernel. Specifically, we construct a kernel using Radial Basis Function ( RBF ) with graph structure induced by Laplacian and learnable Finite Impulse Response ( FIR ) filter. We approximate the kernel using Random Fourier Features ( RFFs ) which transforms the GP prior to a Bayesian formulation, which are subsequently learnt using a single layer neural network with size equal to number of RFF features. G-NAMRFF is light weight with 168 × fewer parameters compared to GNAN . Despite its compact size, G-NAMRFF matches or outperforms state-of-the-art GNNs and GNAN on node and graph classification tasks, delivering real-time interpretability without sacrificing accuracy 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 784dbc6f-1852-4827-aefa-f53d16337f95Builds on12
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Parameterized Explainer for Graph Neural NetworkDongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu et al.NeurIPS 2020 · 888 citations
- Neural Additive Models: Interpretable Machine Learning with Neural NetsRishabh Agarwal, Levi Melnick, Nicholas Frosst, Xuezhou Zhang et al.NeurIPS 2021 · 663 citations
- Simple Spectral Graph ConvolutionHao Zhu, Piotr KoniuszICLR 2021 · 352 citations
Related papers
- The Intelligible and Effective Graph Neural Additive NetworkMaya Bechler-Speicher, Amir Globerson, Ran Gilad-BachrachNeurIPS 2024 · 31 citations
- Gaussian Process Neural Additive ModelsWei Zhang, Brian Barr, John PaisleyAAAI 2024 · 16 citations
- GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural NetworksXiaoqi Wang, Han-Wei ShenICLR 2023 · 10 citations
- XGNN: Towards Model-Level Explanations of Graph Neural NetworksHao Yuan, Jiliang Tang, Xia Hu, Shuiwang JiKDD 2020 · 261 citations
- GraLSP: Graph Neural Networks with Local Structural PatternsYilun Jin, Guojie Song, Chuan ShiAAAI 2020 · 54 citations
