Trajectory-Aware Certified Decentralized Unlearning via SGD Stability
Hengliang Wu, Jiale Yang, Shuzhen Chen, Di Wang, Dongxiao Yu, Youming Tao
摘要
Decentralized Unlearning (DU) aims to remove the influence of specific clients from a collaboratively trained global model. However, existing methods suffer from strong reliance on static, problem-specific hyperparameters or restrictive convexity assumptions, limiting their general applicability. To overcome these limitations, we propose TRA jectory-aware CE rtified D ecentralized U nlearning ( TRACE-DU ), a generic unlearning framework for decentralized training. TRACE-DU introduces a fine-grained sensitivity analysis that leverages local SGD updates and decentralized training dynamics, thereby eliminating the need for convexity assumptions and reducing dependence on manually tuned parameters. By integrating strategic checkpoint selection with calibrated noise perturbation, the proposed framework enables efficient certified unlearning. Moreover, we exploit historical model trajectories to extend this framework, enabling it to naturally support sequential unlearning requests from an arbitrary number of clients. We provide theoretical guarantees for certified unlearning and derive sensitivity bounds under both convex and non-convex loss functions. Experimental results demonstrate that our framework outperforms state-of-the-art baselines across diverse metrics.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Certified Data Removal from Machine Learning ModelsChuan Guo, Tom Goldstein, Awni Y. Hannun, Laurens van der MaatenICML 2020 · 被引用 633 次
- A Unified Theory of Decentralized SGD with Changing Topology and Local UpdatesAnastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi 等ICML 2020 · 被引用 623 次
- Remember What You Want to Forget: Algorithms for Machine UnlearningAyush Sekhari, Jayadev Acharya, Gautam Kamath, Ananda Theertha SureshNeurIPS 2021 · 被引用 516 次
- Langevin Unlearning: A New Perspective of Noisy Gradient Descent for Machine UnlearningEli Chien, Haoyu Wang, Ziang Chen, Pan LiNeurIPS 2024 · 被引用 58 次
- Algorithms that Approximate Data Removal: New Results and LimitationsVinith M. Suriyakumar, Ashia C. WilsonNeurIPS 2022 · 被引用 55 次
相关 Paper
- Fully Decentralized Certified UnlearningHithem Lamri, Michail ManiatakosCVPR 2026 · 被引用 1 次
- PDUDT: Provable Decentralized Unlearning under Dynamic TopologiesJing Qiao, Yu Liu, Zengzhe Chen, Mingyi Li 等ICML 2025
- Towards Certified Unlearning for Deep Neural NetworksBinchi Zhang, Yushun Dong, Tianhao Wang, Jundong LiICML 2024 · 被引用 31 次
- Certified Unlearning in Decentralized Federated LearningHengliang Wu, Youming Tao, Anhao Zhou, Shuzhen Chen 等INFOCOM 2026 · 被引用 1 次
- LMCleaner: Efficient and Certified Online Unlearning via Influence Propagation TruncationJie Xu, Zihan Wu, Wenbo Pan, Jiao Yin 等ICML 2026
