Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness
Cheng-Long Wang, Qi Li, Zihang Xiang, Yinzhi Cao, Di Wang
摘要
Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks (MIAs) are widely used to externally assess successful unlearning. However, existing methods face two key limitations: (1) maximizing MIA effectiveness (e.g., via online attacks) requires prohibitive computational resources, often exceeding retraining costs; (2) MIAs, designed for binary inclusion tests, struggle to capture granular changes in approximate unlearning. To address these challenges, we propose the Interpolated Approximate Measurement (IAM), a framework natively designed for unlearning inference. IAM quantifies sample-level unlearning completeness by interpolating the model's generalization-fitting behavior gap on queried samples. IAM achieves strong performance in binary inclusion tests for exact unlearning and high correlation for approximate unlearning--scalable to LLMs using just one pre-trained shadow model. We theoretically analyze how IAM's scoring mechanism maintains performance efficiently. We then apply IAM to recent approximate unlearning algorithms, revealing general risks of both over-unlearning and under-unlearning, underscoring the need for stronger safeguards in approximate unlearning systems. The code is available at https://github.com/Happy2Git/Unlearning_Inference_IAM.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Towards Reasoning-Preserving Unlearning in Multimodal Large Language ModelsHongji Li, Manjiang Yu, Junchi Yao, PRIYANKA SINGH 等CVPR 2026 · 被引用 3 次
- CoLA: A Choice Leakage Attack Framework to Expose Privacy Risks in Subset TrainingQi Li, Cheng-Long Wang, Yinzhi Cao, Di WangACL 2026 · 被引用 2 次
- Investigating Novice Researchers' Perceptions of Research Privacy Within LLM-Assisted WorkflowsShuning Zhang, Changxi Wen, Eve He, Ying Ma 等CCS 2026 · 被引用 1 次
- Black-Box Membership Inference Attacks for Video Training Data in Multimodal Large Language ModelsJinrui Wang, Zhenfeng Gao, Wendan Wang, Huili Wang 等ACL 2026
- Trajectory-Aware Certified Decentralized Unlearning via SGD StabilityHengliang Wu, Jiale Yang, Shuzhen Chen, Di Wang 等ICML 2026
它引用的顶会 Paper42
- Membership Inference Attacks Against Machine Learning ModelsReza Shokri, Marco Stronati, Congzheng Song, Vitaly ShmatikovS&P 2017 · 被引用 5,137 次
- Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski 等USENIX Security 2021 · 被引用 2,866 次
- Machine UnlearningLucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia 等S&P 2021 · 被引用 1,381 次
- Membership Inference Attacks From First PrinciplesNicholas Carlini, Steve Chien, Milad Nasr, Shuang Song 等S&P 2022 · 被引用 1,049 次
- Certified Data Removal from Machine Learning ModelsChuan Guo, Tom Goldstein, Awni Y. Hannun, Laurens van der MaatenICML 2020 · 被引用 633 次
相关 Paper
- A Reliable Cryptographic Framework for Empirical Machine Unlearning EvaluationYiwen Tu, Pingbang Hu, Jiaqi MaNeurIPS 2025 · 被引用 6 次
- Machine Unlearning Fails to Remove Data Poisoning AttacksMartin Pawelczyk, Jimmy Z. Di, Yiwei Lu, Gautam Kamath 等ICLR 2025
- Adversarial Machine UnlearningZonglin Di, Sixie Yu, Yevgeniy Vorobeychik, Yang LiuICLR 2025 · 被引用 1 次
- Not All Wrong is Bad: Using Adversarial Examples for UnlearningAli Ebrahimpour Boroojeny, Hari Sundaram, Varun ChandrasekaranICML 2025
- Reminiscence Attack on Residuals: Exploiting Approximate Machine Unlearning for PrivacyYaxin Xiao, Qingqing Ye, Li Hu, Huadi Zheng 等ICCV 2025 · 被引用 6 次
