Influence-Disentangled Federated Training: Learning Models That Are Easy to Unlearn
Canran Xiao, Qianyu Chen, Liwei Hou
摘要
Federated learning increasingly faces deletion requests that require client-level unlearning without sacrificing model quality, yet a client’s influence is often deeply entangled after many rounds of aggregation. We aim to make unlearning fast, stable, and predictable by reducing the gap to leave-one-out retraining under realistic heterogeneity. We propose Influence-Disentangled Federated Training (IDFT), which instruments standard FedAvg with training-time influence logging: each round’s updates are decomposed into shared covarying directions and a client-separable residual trace, and an entanglement-aware shrinkage suppresses non-removable components. Deletion then becomes a single subtraction followed by a short anchored repair, yielding a stability-style characterization of retrain fidelity driven by the unremoved residual. Across representative benchmarks, IDFT consistently attains the lowest retrain gap (Avg. Gap) on multiple dataset--architecture pairs and improves the fidelity--cost frontier, matching retrain-level forgetting with substantially lower communication/compute than history-heavy baselines. These results suggest a practical pathway to unlearning-friendly federated systems by designing for removability during training rather than relying solely on post-hoc corrections.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Machine UnlearningLucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia 等S&P 2021 · 被引用 1,381 次
- Federated Unlearning via Class-Discriminative PruningJunxiao Wang, Song Guo, Xin Xie, Heng QiWWW 2022 · 被引用 217 次
- The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid RetrainingYi Liu, Lei Xu, Xingliang Yuan, Cong Wang 等INFOCOM 2022 · 被引用 189 次
- Confusion-Resistant Federated Learning via Diffusion-Based Data Harmonization on Non-IID DataXiaohong Chen, Canran Xiao, Yongmei LiuNeurIPS 2024 · 被引用 41 次
- Federated Unlearning with Gradient Descent and Conflict MitigationZibin Pan, Zhichao Wang, Chi Li, Kaiyan Zheng 等AAAI 2025 · 被引用 5 次
相关 Paper
- GDFA: Geometry-Driven Federated Unlearning with Directional Task Vector AlignmentXiuting Weng, Ruizhi Pu, Yuanhang Yao, Kun Yue 等CVPR 2026
- Certified Unlearning in Decentralized Federated LearningHengliang Wu, Youming Tao, Anhao Zhou, Shuzhen Chen 等INFOCOM 2026 · 被引用 1 次
- PDUDT: Provable Decentralized Unlearning under Dynamic TopologiesJing Qiao, Yu Liu, Zengzhe Chen, Mingyi Li 等ICML 2025
- Forgetting Through Transforming: Enabling Federated Unlearning via Class-Aware Representation TransformationQi Guo, Zhen Tian, Minghao Yao, Saiyu Qi 等ICCV 2025 · 被引用 2 次
- Communication Efficient and Provable Federated UnlearningYouming Tao, Cheng-Long Wang, Miao Pan, Dongxiao Yu 等VLDB 2024 · 被引用 35 次
