Privacy Auditing of Multi-Domain Graph Pre-Trained Model Under Membership Inference Attacks
Jiayi Luo, Qingyun Sun, Yuecen Wei, Haonan Yuan, Xingcheng Fu, Jianxin Li
摘要
Multi-domain graph pre-training has emerged as a pivotal technique in developing graph foundation models. While it greatly improves the generalization of graph neural networks, its privacy risks under membership inference attacks (MIAs), which aim to identify whether a specific instance was used in training (member), remain largely unexplored. However, effectively conducting MIAs against multi-domain graph pre-trained models is a significant challenge due to: (i) Enhanced Generalization Capability: Multi-domain pre-training reduces the overfitting characteristics commonly exploited by MIAs. (ii) Unrepresentative Shadow Datasets: Diverse training graphs hinder the obtaining of reliable shadow graphs. (iii) Weakened Membership Signals: Embedding-based outputs offer less informative cues than logits for MIAs. To tackle these challenges, we propose MGP-MIA, a novel framework for Membership Inference Attacks against Multi-domain Graph Pre-trained models. Specifically, we first propose a membership signal amplification mechanism that amplifies the overfitting characteristics of target models via machine unlearning. We then design an incremental shadow model construction mechanism that builds a reliable shadow model with limited shadow graphs via incremental learning. Finally, we introduce a similarity-based inference mechanism that identifies members based on their similarity to positive and negative samples. Extensive experiments demonstrate the effectiveness of our proposed MGP-MIA and reveal the privacy risks of multi-domain graph pre-training.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper14
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen 等NeurIPS 2020 · 被引用 3,042 次
- Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated LearningMilad Nasr, Reza Shokri, Amir HoumansadrS&P 2019 · 被引用 1,778 次
- Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts GeneralizationStanislaw Jastrzebski, Devansh Arpit, Oliver Åstrand, Giancarlo Kerg 等ICML 2021 · 被引用 78 次
- Knowledge Unlearning for Mitigating Privacy Risks in Language ModelsJoel Jang, Dongkeun Yoon, Sohee Yang, Sungmin Cha 等ACL 2023 · 被引用 48 次
- SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain AdaptationXingtong Yu, Zechuan Gong, Chang Zhou, Yuan Fang 等WWW 2025 · 被引用 45 次
相关 Paper
- Rigging the Foundation: Manipulating Pre-training for Advanced Membership Inference AttacksZihao Wang, Rui Zhu, Zhikun Zhang, Haixu Tang 等S&P 2025
- Imprint of the Forgotten: Stealthy Membership Inference in Unlearned Graph Neural NetworksHe Zhang, Bang Wu, Xiaoning Liu, Karin Verspoor 等AAAI 2026
- Practical Membership Inference Attacks Against Large-Scale Multi-Modal Models: A Pilot StudyMyeongseob Ko, Ming Jin, Chenguang Wang, Ruoxi JiaICCV 2023 · 被引用 51 次
- Cascading and Proxy Membership Inference AttacksYuntao Du, Jiacheng Li, Yuetian Chen, Kaiyuan Zhang 等NDSS 2026 · 被引用 8 次
- MI: Multi-modal Models Membership InferencePingyi Hu, Zihan Wang, Ruoxi Sun, Hu Wang 等NeurIPS 2022 · 被引用 39 次
