Rounding-Guided Backdoor Injection in Deep Learning Model Quantization
Xiangxiang Chen, Peixin Zhang, Jun Sun, Wenhai Wang, Jingyi Wang
摘要
Model quantization is a popular technique for deploying deep learning models on resource-constrained environments. However, it may also introduce previously overlooked security risks. In this work, we present QURA, a novel backdoor attack that exploits model quantization to embed malicious behaviors. Unlike conventional backdoor attacks relying on training data poisoning or model training manipulation, QURA solely works using the quantization operations. In particular, QURA first employs a novel weight selection strategy to identify critical weights that influence the backdoor target (with the goal of perserving the model's overall performance in mind). Then, by optimizing the rounding direction of these weights, we amplify the backdoor effect across model layers without degrading accuracy. Extensive experiments demonstrate that QURA achieves nearly 100% attack success rates in most cases, with negligible performance degradation. Furthermore, we show that QURA can adapt to bypass existing backdoor defenses, underscoring its threat potential. Our findings highlight critical vulnerability in widely used model quantization process, emphasizing the need for more robust security measures. Our implementation is available at https://github.com/cxx122/QuRA .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper28
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- QLoRA: Efficient Finetuning of Quantized LLMsTim Dettmers, Artidoro Pagnoni, Ari Holtzman, Luke ZettlemoyerNeurIPS 2023 · 被引用 5,863 次
- Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural NetworksBolun Wang, Yuanshun Yao, Shawn Shan, Huiying Li 等S&P 2019 · 被引用 1,801 次
- Accessorize to a Crime: Real and Stealthy Attacks on State-of-the-Art Face RecognitionMahmood Sharif, Sruti Bhagavatula, Lujo Bauer, Michael K. ReiterCCS 2016 · 被引用 1,765 次
- Trojaning Attack on Neural NetworksYingqi Liu, Shiqing Ma, Yousra Aafer, Wen-Chuan Lee 等NDSS 2018 · 被引用 1,377 次
相关 Paper
- LLMQuA: Practical Backdoor Injection on Large Language Model QuantizationXiangxiang Chen, Peixin Zhang, Jun Sun, Jin Song Dong 等WWW 2026
- Qu-ANTI-zation: Exploiting Quantization Artifacts for Achieving Adversarial OutcomesSanghyun Hong, Michael-Andrei Panaitescu-Liess, Yigitcan Kaya, Tudor DumitrasNeurIPS 2021 · 被引用 30 次
- Nearest is Not Dearest: Towards Practical Defense Against Quantization-Conditioned Backdoor AttacksBoheng Li, Yishuo Cai, Haowei Li, Feng Xue 等CVPR 2024
- Purifying Quantization-conditioned Backdoors via Layer-wise Activation Correction with Distribution ApproximationBoheng Li, Yishuo Cai, Jisong Cai, Yiming Li 等ICML 2024 · 被引用 19 次
- ACQ: Few-shot Backdoor Defense via Activation Clipping and QuantizingYulin Jin, Xiaoyu Zhang, Jian Lou, Xiaofeng ChenACM MM 2023 · 被引用 2 次
