Reliable Representations Make A Stronger Defender: Unsupervised Structure Refinement for Robust GNN
Kuan Li, Yang Liu, Xiang Ao, Jianfeng Chi, Jinghua Feng, Hao Yang, Qing He
Abstract
Benefiting from the message passing mechanism, Graph Neural Networks (GNNs) have been successful on flourish tasks over graph data. However, recent studies have shown that attackers can catastrophically degrade the performance of GNNs by maliciously modifying the graph structure. A straightforward solution to remedy this issue is to model the edge weights by learning a metric function between pairwise representations of two end nodes, which attempts to assign low weights to adversarial edges. The existing methods use either raw features or representations learned by supervised GNNs to model the edge weights. However, both strategies are faced with some immediate problems: raw features cannot represent various properties of nodes (e.g., structure information), and representations learned by supervised GNN may suffer from the poor performance of the classifier on the poisoned graph. We need representations that carry both feature information and as mush correct structure information as possible and are insensitive to structural perturbations. To this end, we propose an unsupervised pipeline, named STABLE, to optimize the graph structure. Finally, we input the well-refined graph into a downstream classifier. For this part, we design an advanced GCN that significantly enhances the robustness of vanilla GCN [24] without increasing the time complexity. Extensive experiments on four real-world graph benchmarks demonstrate that STABLE outperforms the state-of-the-art methods and successfully defends against various attacks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 059d288f-b2b7-4b70-902a-4e930ede1f33Cited by top-tier papers32
- SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy OptimizationDongcheng Zou, Hao Peng, Xiang Huang, Renyu Yang et al.WWW 2023 · 78 citations
- Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure LearningZhixiang Shen, Shuo Wang, Zhao KangNeurIPS 2024 · 46 citations
- Adversarial Robustness in Graph Neural Networks: A Hamiltonian ApproachKai Zhao, Qiyu Kang, Yang Song, Rui She et al.NeurIPS 2023 · 45 citations
- RAGraph: A General Retrieval-Augmented Graph Learning FrameworkXinke Jiang, Rihong Qiu, Yongxin Xu, Wentao Zhang et al.NeurIPS 2024 · 42 citations
- FLOOD: A Flexible Invariant Learning Framework for Out-of-Distribution Generalization on GraphsYang Liu, Xiang Ao, Fuli Feng, Yunshan Ma et al.KDD 2023 · 40 citations
Builds on18
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
- Graph Representation Learning via Graphical Mutual Information MaximizationZhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng et al.WWW 2020 · 682 citations
Related papers
- Uncertainty-Matching Graph Neural Networks to Defend Against Poisoning AttacksUday Shankar Shanthamallu, Jayaraman J. Thiagarajan, Andreas SpaniasAAAI 2021 · 19 citations
- Graph Structure Learning for Robust Graph Neural NetworksWei Jin, Yao Ma, Xiaorui Liu, Xianfeng Tang et al.KDD 2020 · 604 citations
- Towards an Optimal Asymmetric Graph Structure for Robust Semi-supervised Node ClassificationZixing Song, Yifei Zhang, Irwin KingKDD 2022 · 30 citations
- GNNGuard: Defending Graph Neural Networks against Adversarial AttacksXiang Zhang, Marinka ZitnikNeurIPS 2020 · 416 citations
- Self-Guided Robust Graph Structure RefinementYeonjun In, Kanghoon Yoon, Kibum Kim, Kijung Shin et al.WWW 2024 · 11 citations
