BeDKD: Backdoor Defense Based on Directional Mapping Module and Adversarial Knowledge Distillation
Zhengxian Wu, Juan Wen, Wanli Peng, Yinghan Zhou, Changtong Dou, Yiming Xue
摘要
Although existing backdoor defenses have gained success in mitigating backdoor attacks, they still face substantial challenges. In particular, most of them rely on large amounts of clean data to weaken the backdoor mapping but generally struggle with residual trigger effects, resulting in persistently high attack success rates (ASR). Therefore, in this paper, we propose a novel Backdoor defense method based on Directional mapping module and adversarial Knowledge Distillation (BeDKD), which balances the trade-off between defense effectiveness and model performance using a small amount of clean and poisoned data. We first introduce a directional mapping module to identify poisoned data, which destroys clean mapping while keeping backdoor mapping on a small set of flipped clean data. Then, the adversarial knowledge distillation is designed to reinforce clean mapping and suppress backdoor mapping through a cycle iteration mechanism between trust and punish distillations using clean and identified poisoned data. We conduct experiments to mitigate mainstream attacks on three datasets, and experimental results demonstrate that BeDKD surpasses the state-of-the-art defenses and reduces the ASR by 98% without significantly reducing the CACC.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Contrastive Representation DistillationYonglong Tian, Dilip Krishnan, Phillip IsolaICLR 2020 · 被引用 1,305 次
- Attack of the Tails: Yes, You Really Can Backdoor Federated LearningHongyi Wang, Kartik Sreenivasan, Shashank Rajput, Harit Vishwakarma 等NeurIPS 2020 · 被引用 862 次
- Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural NetworksYige Li, Xixiang Lyu, Nodens Koren, Lingjuan Lyu 等ICLR 2021 · 被引用 548 次
- Defending against Backdoor Attacks in Natural Language GenerationXiaofei Sun, Xiaoya Li, Yuxian Meng, Xiang Ao 等AAAI 2023 · 被引用 65 次
- Defending Pre-trained Language Models as Few-shot Learners against Backdoor AttacksZhaohan Xi, Tianyu Du, Changjiang Li, Ren Pang 等NeurIPS 2023 · 被引用 61 次
相关 Paper
- Backdoor Attacks Against Dataset DistillationYugeng Liu, Zheng Li, Michael Backes, Yun Shen 等NDSS 2023
- Beating Backdoor Attack at Its Own GameMin Liu, Alberto L. Sangiovanni-Vincentelli, Xiangyu YueICCV 2023 · 被引用 19 次
- Redeem Myself: Purifying Backdoors in Deep Learning Models using Self Attention DistillationXueluan Gong, Yanjiao Chen, Wang Yang, Qian Wang 等S&P 2023
- From Toxic to Trustworthy: Using Self-Distillation and Semi-supervised Methods to Refine Neural NetworksXianda Zhang, Baolin Zheng, Jianbao Hu, Chengyang Li 等AAAI 2024 · 被引用 3 次
- MultiKD: Backdoor Defense in Federated Graph Learning via Attention-Guided Multi-Teacher DistillationJiale Zhang, Yanan Wang, Bosen Rao, Chengcheng Zhu 等AAAI 2026
