Influence-Disentangled Federated Training: Learning Models That Are Easy to Unlearn
Canran Xiao, Qianyu Chen, Liwei Hou
Abstract
Federated learning increasingly faces deletion requests that require client-level unlearning without sacrificing model quality, yet a client’s influence is often deeply entangled after many rounds of aggregation. We aim to make unlearning fast, stable, and predictable by reducing the gap to leave-one-out retraining under realistic heterogeneity. We propose Influence-Disentangled Federated Training (IDFT), which instruments standard FedAvg with training-time influence logging: each round’s updates are decomposed into shared covarying directions and a client-separable residual trace, and an entanglement-aware shrinkage suppresses non-removable components. Deletion then becomes a single subtraction followed by a short anchored repair, yielding a stability-style characterization of retrain fidelity driven by the unremoved residual. Across representative benchmarks, IDFT consistently attains the lowest retrain gap (Avg. Gap) on multiple dataset--architecture pairs and improves the fidelity--cost frontier, matching retrain-level forgetting with substantially lower communication/compute than history-heavy baselines. These results suggest a practical pathway to unlearning-friendly federated systems by designing for removability during training rather than relying solely on post-hoc corrections.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1d16748b-96d8-4a52-ae19-269691bce95fBuilds on9
- Machine UnlearningLucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia et al.S&P 2021 · 1,381 citations
- Federated Unlearning via Class-Discriminative PruningJunxiao Wang, Song Guo, Xin Xie, Heng QiWWW 2022 · 217 citations
- The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid RetrainingYi Liu, Lei Xu, Xingliang Yuan, Cong Wang et al.INFOCOM 2022 · 189 citations
- Confusion-Resistant Federated Learning via Diffusion-Based Data Harmonization on Non-IID DataXiaohong Chen, Canran Xiao, Yongmei LiuNeurIPS 2024 · 41 citations
- Federated Unlearning with Gradient Descent and Conflict MitigationZibin Pan, Zhichao Wang, Chi Li, Kaiyan Zheng et al.AAAI 2025 · 5 citations
Related papers
- GDFA: Geometry-Driven Federated Unlearning with Directional Task Vector AlignmentXiuting Weng, Ruizhi Pu, Yuanhang Yao, Kun Yue et al.CVPR 2026
- Certified Unlearning in Decentralized Federated LearningHengliang Wu, Youming Tao, Anhao Zhou, Shuzhen Chen et al.INFOCOM 2026 · 1 citation
- PDUDT: Provable Decentralized Unlearning under Dynamic TopologiesJing Qiao, Yu Liu, Zengzhe Chen, Mingyi Li et al.ICML 2025
- Forgetting Through Transforming: Enabling Federated Unlearning via Class-Aware Representation TransformationQi Guo, Zhen Tian, Minghao Yao, Saiyu Qi et al.ICCV 2025 · 2 citations
- Communication Efficient and Provable Federated UnlearningYouming Tao, Cheng-Long Wang, Miao Pan, Dongxiao Yu et al.VLDB 2024 · 35 citations
