Trajectory-Aware Certified Decentralized Unlearning via SGD Stability
Hengliang Wu, Jiale Yang, Shuzhen Chen, Di Wang, Dongxiao Yu, Youming Tao
Abstract
Decentralized Unlearning (DU) aims to remove the influence of specific clients from a collaboratively trained global model. However, existing methods suffer from strong reliance on static, problem-specific hyperparameters or restrictive convexity assumptions, limiting their general applicability. To overcome these limitations, we propose TRA jectory-aware CE rtified D ecentralized U nlearning ( TRACE-DU ), a generic unlearning framework for decentralized training. TRACE-DU introduces a fine-grained sensitivity analysis that leverages local SGD updates and decentralized training dynamics, thereby eliminating the need for convexity assumptions and reducing dependence on manually tuned parameters. By integrating strategic checkpoint selection with calibrated noise perturbation, the proposed framework enables efficient certified unlearning. Moreover, we exploit historical model trajectories to extend this framework, enabling it to naturally support sequential unlearning requests from an arbitrary number of clients. We provide theoretical guarantees for certified unlearning and derive sensitivity bounds under both convex and non-convex loss functions. Experimental results demonstrate that our framework outperforms state-of-the-art baselines across diverse metrics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c0b087df-c0c2-474f-814a-adcd3f973745Builds on18
- Certified Data Removal from Machine Learning ModelsChuan Guo, Tom Goldstein, Awni Y. Hannun, Laurens van der MaatenICML 2020 · 633 citations
- A Unified Theory of Decentralized SGD with Changing Topology and Local UpdatesAnastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi et al.ICML 2020 · 623 citations
- Remember What You Want to Forget: Algorithms for Machine UnlearningAyush Sekhari, Jayadev Acharya, Gautam Kamath, Ananda Theertha SureshNeurIPS 2021 · 516 citations
- Langevin Unlearning: A New Perspective of Noisy Gradient Descent for Machine UnlearningEli Chien, Haoyu Wang, Ziang Chen, Pan LiNeurIPS 2024 · 58 citations
- Algorithms that Approximate Data Removal: New Results and LimitationsVinith M. Suriyakumar, Ashia C. WilsonNeurIPS 2022 · 55 citations
Related papers
- Fully Decentralized Certified UnlearningHithem Lamri, Michail ManiatakosCVPR 2026 · 1 citation
- PDUDT: Provable Decentralized Unlearning under Dynamic TopologiesJing Qiao, Yu Liu, Zengzhe Chen, Mingyi Li et al.ICML 2025
- Towards Certified Unlearning for Deep Neural NetworksBinchi Zhang, Yushun Dong, Tianhao Wang, Jundong LiICML 2024 · 31 citations
- Certified Unlearning in Decentralized Federated LearningHengliang Wu, Youming Tao, Anhao Zhou, Shuzhen Chen et al.INFOCOM 2026 · 1 citation
- LMCleaner: Efficient and Certified Online Unlearning via Influence Propagation TruncationJie Xu, Zihan Wu, Wenbo Pan, Jiao Yin et al.ICML 2026
