Not All Low-Pass Filters are Robust in Graph Convolutional Networks
Heng Chang, Yu Rong, Tingyang Xu, Yatao Bian, Shiji Zhou, Xin Wang, Junzhou Huang, Wenwu Zhu
Abstract
Graph Convolutional Networks (GCNs) are promising deep learning approaches in learning representations for graph-structured data. Despite the proliferation of such methods, it is well known that they are vulnerable to carefully crafted adversarial attacks on the graph structure. In this paper, we first conduct an adversarial vulnerability analysis based on matrix perturbation theory. We prove that the lowfrequency components of the symmetric normalized Laplacian, which is usually used as the convolutional filter in GCNs, could be more robust against structural perturbations when their eigenvalues fall into a certain robust interval. Our results indicate that not all low-frequency components are robust to adversarial attacks and provide a deeper understanding of the relationship between graph spectrum and robustness of GCNs. Motivated by the theory, we present GCN-LFR 3 , a general robust co-training paradigm for GCN-based models, that encourages transferring the robustness of low-frequency components with an auxiliary neural network. To this end, GCN-LFR could enhance the robustness of various kinds of GCN-based models against poisoning structural attacks in a plug-and-play manner. Extensive experiments across five benchmark datasets and five GCN-based models also confirm that GCN-LFR is resistant to the adversarial attacks without compromising on performance in the benign situation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 37dec890-adfe-44e3-92b2-8a09f4fcc947Cited by top-tier papers25
- Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily DiscriminatingYixin Liu, Yizhen Zheng, Daokun Zhang, Vincent C. S. Lee et al.AAAI 2023 · 116 citations
- Are Defenses for Graph Neural Networks Robust?Felix Mujkanovic, Simon Geisler, Stephan Günnemann, Aleksandar BojchevskiNeurIPS 2022 · 79 citations
- Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph SpectrumWei Ai, Fuchen Zhang, Yuntao Shou, Tao Meng et al.AAAI 2025 · 64 citations
- Query Driven-Graph Neural Networks for Community Search: From Non-Attributed, Attributed, to Interactive AttributedYuli Jiang, Yu Rong, Hong Cheng, Xin Huang et al.VLDB 2022 · 58 citations
- Robust Mid-Pass Filtering Graph Convolutional NetworksJincheng Huang, Lun Du, Xu Chen, Qiang Fu et al.WWW 2023 · 57 citations
Builds on19
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Self-Supervised Graph Transformer on Large-Scale Molecular DataYu Rong, Yatao Bian, Tingyang Xu, Weiyang Xie et al.NeurIPS 2020 · 1,113 citations
Related papers
- Power up! Robust Graph Convolutional Network via Graph PoweringMing Jin, Heng Chang, Wenwu Zhu, Somayeh SojoudiAAAI 2021 · 31 citations
- Graph Structural Attack by Perturbing Spectral DistanceLu Lin, Ethan Blaser, Hongning WangKDD 2022 · 28 citations
- Certified Robustness of Graph Convolution Networks for Graph Classification under Topological AttacksHongwei Jin, Zhan Shi, Venkata Jaya Shankar Ashish Peruri, Xinhua ZhangNeurIPS 2020 · 46 citations
- Graph Structure Learning for Robust Graph Neural NetworksWei Jin, Yao Ma, Xiaorui Liu, Xianfeng Tang et al.KDD 2020 · 604 citations
- Robust Tensor Graph Convolutional Networks via T-SVD based Graph AugmentationZhebin Wu, Lin Shu, Ziyue Xu, Yaomin Chang et al.KDD 2022 · 20 citations
