Is Graph Unlearning Ready for Practice? A Benchmark on Efficiency, Utility, and Forgetting
Samyak Jain, Ronak Kalvani, sainyam galhotra, Sayan Ranu
Abstract
Graph Neural Networks (Gnns) are increasingly being deployed in sensitive, user-centric applications where regulations such as the GDPR mandate the ability to remove data upon request. This has spurred interest in graph unlearning, the task of removing the influence of specific training data from a trained Gnn without retraining from scratch. While several unlearning techniques have recently emerged, the field lacks a principled benchmark to assess whether these methods truly provide a practical alternative to retraining and, if so, how to choose among them for different workloads. In this work, we present the first systematic benchmark for Gnn unlearning, structured around three core desiderata: efficiency (is unlearning faster than retraining?), utility (does the unlearned model preserve predictive performance and align with the retrained gold standard?), and forgetting (does the model genuinely eliminate the influence of removed data?). Through extensive experiments across diverse datasets and deletion scenarios, we deliver a unified assessment of existing approaches, surfacing their trade-offs and limitations. Crucially, our findings show that most unlearning techniques are not yet practical for large-scale graphs. At the same time, our benchmarking yields actionable guidelines on when unlearning can be a viable alternative to retraining and how to select among methods for different workloads, thereby charting a path for future research toward more practical, scalable, and trustworthy graph unlearning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on12
- Machine UnlearningLucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia et al.S&P 2021 · 1,381 citations
- Certified Data Removal from Machine Learning ModelsChuan Guo, Tom Goldstein, Awni Y. Hannun, Laurens van der MaatenICML 2020 · 633 citations
- Graph UnlearningMin Chen, Zhikun Zhang, Tianhao Wang, Michael Backes et al.CCS 2022 · 103 citations
- GIF: A General Graph Unlearning Strategy via Influence FunctionJiancan Wu, Yi Yang, Yuchun Qian, Yongduo Sui et al.WWW 2023 · 97 citations
- Unlearning Graph Classifiers with Limited Data ResourcesChao Pan, Eli Chien, Olgica MilenkovicWWW 2023 · 43 citations
Related papers
- Efficient Model Updates for Approximate Unlearning of Graph-Structured DataEli Chien, Chao Pan, Olgica MilenkovicICLR 2023
- Re-understanding Graph Unlearning through MemorizationPengfei Ding, Yan Wang, Guanfeng LiuWWW 2026 · 1 citation
- Pre-training for Recommendation UnlearningGuoxuan Chen, Lianghao Xia, Chao HuangSIGIR 2025 · 2 citations
- Erase Then Rectify: A Training-Free Parameter Editing Approach for Cost-Effective Graph UnlearningZhe-Rui Yang, Jindong Han, Chang-Dong Wang, Hao LiuAAAI 2025 · 13 citations
- IDEA: A Flexible Framework of Certified Unlearning for Graph Neural NetworksYushun Dong, Binchi Zhang, Zhenyu Lei, Na Zou et al.KDD 2024 · 11 citations
