Interpretable and Parameter Efficient Graph Neural Additive Models with Random Fourier Features
Thummaluru Siddartha Reddy, Vempalli Naga Sai Saketh, Mahesh Chandran
摘要
Graph Neural Networks (GNNs) excel at jointly modeling node features and topology, yet their black-box nature limits their adoption in real-world applications where interpretability is desired. Inspired by the success of interpretable Neural Additive Models (NAM) for tabular data, Graph Neural Additive Network (GNAN) extends the additive modeling approach to graph data to overcome limitations of GNNs. While being interpretable, GNAN representation learning overlooks the importance of local aggregation and more importantly suffers from parameter complexity. To mitigate the above challenges, we introduce Graph Neural Additive Model with Random Fourier Features ( G-NAMRFF ), a lightweight, self-interpretable graph additive architecture. G-NAMRFF represents each node embedding as the sum of feature-wise contributions where contributions are modeled via a Gaussian process (GP) with a graph-and feature-aware kernel. Specifically, we construct a kernel using Radial Basis Function ( RBF ) with graph structure induced by Laplacian and learnable Finite Impulse Response ( FIR ) filter. We approximate the kernel using Random Fourier Features ( RFFs ) which transforms the GP prior to a Bayesian formulation, which are subsequently learnt using a single layer neural network with size equal to number of RFF features. G-NAMRFF is light weight with 168 × fewer parameters compared to GNAN . Despite its compact size, G-NAMRFF matches or outperforms state-of-the-art GNNs and GNAN on node and graph classification tasks, delivering real-time interpretability without sacrificing accuracy 1 .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei 等ICLR 2020 · 被引用 1,445 次
- Parameterized Explainer for Graph Neural NetworkDongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu 等NeurIPS 2020 · 被引用 888 次
- Neural Additive Models: Interpretable Machine Learning with Neural NetsRishabh Agarwal, Levi Melnick, Nicholas Frosst, Xuezhou Zhang 等NeurIPS 2021 · 被引用 663 次
- Simple Spectral Graph ConvolutionHao Zhu, Piotr KoniuszICLR 2021 · 被引用 352 次
相关 Paper
- The Intelligible and Effective Graph Neural Additive NetworkMaya Bechler-Speicher, Amir Globerson, Ran Gilad-BachrachNeurIPS 2024 · 被引用 31 次
- Gaussian Process Neural Additive ModelsWei Zhang, Brian Barr, John PaisleyAAAI 2024 · 被引用 16 次
- GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural NetworksXiaoqi Wang, Han-Wei ShenICLR 2023 · 被引用 10 次
- XGNN: Towards Model-Level Explanations of Graph Neural NetworksHao Yuan, Jiliang Tang, Xia Hu, Shuiwang JiKDD 2020 · 被引用 261 次
- GraLSP: Graph Neural Networks with Local Structural PatternsYilun Jin, Guojie Song, Chuan ShiAAAI 2020 · 被引用 54 次
