Diversity-aware Weight Perturbation Promotes Robust Adaptation
Zibo Chen, Ruxin Li, Zilu Wang
Abstract
Compute-In-Memory (CIM) accelerators are promising for energy-efficient edge inference, yet they faces fundamental challenges when deploying Deep Neural Networks (DNNs), as hardware-induced weight perturbations from intrinsic noise and device drift degrade accuracy and impede reliable inference. To tackle this challenge, we propose Diversity-aware Weight Perturbation (DWP), an immune-system-inspired training method that emulates affinity-based selection by exploiting sample-level prediction disagreement under diverse noise realizations to guide adaptive sample weighting, building robustness to weight perturbation. Experiments show that DWP-trained models consistently yield superior robustness, achieving over 15% accuracy improvements compared to standard-trained models under severe weight perturbations (mismatch level up to 70%) and maintaining inference accuracy at 90% over a simulated one-year CIM operation with only 2%–4% variation in accuracy. Moreover, under matched model and inference configurations, deployment on low-precision CIM hardware reduces inference energy by 38% compared to a GPU baseline. These results demonstrate that DWP enables robust and energy-efficient neural network deployment on resource-constrained edge devices with inherent hardware uncertainties.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext df5049b8-e345-4942-a12f-fb8b5266bed4Builds on8
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Adversarial Weight Perturbation Helps Robust GeneralizationDongxian Wu, Shu-Tao Xia, Yisen WangNeurIPS 2020 · 917 citations
- Improving Out-of-Distribution Robustness via Selective AugmentationHuaxiu Yao, Yu Wang, Sai Li, Linjun Zhang et al.ICML 2022 · 275 citations
- One-bit Flip is All You Need: When Bit-flip Attack Meets Model TrainingJianshuo Dong, Han Qiu, Yiming Li, Tianwei Zhang et al.ICCV 2023 · 33 citations
- Connecting Certified and Adversarial TrainingYuhao Mao, Mark Niklas Müller, Marc Fischer, Martin T. VechevNeurIPS 2023 · 14 citations
Related papers
- Leveraging Noise and Aggressive Quantization of In-Memory Computing for Robust DNN Hardware Against Adversarial Input and Weight AttacksSai Kiran Cherupally, Adnan Siraj Rakin, Shihui Yin, Mingoo Seok et al.DAC 2021 · 10 citations
- Network Insensitivity to Parameter Noise via Parameter Attack During TrainingJulian Büchel, Fynn Firouz Faber, Dylan Richard MuirICLR 2022 · 6 citations
- TFix: Exploiting the Natural Redundancy of Ternary Neural Networks for Fault Tolerant In-Memory Vector Matrix MultiplicationAkul Malhotra, Chunguang Wang, Sumeet Kumar GuptaDAC 2023 · 4 citations
- Improving robustness to corruptions with multiplicative weight perturbationsTrung Q. Trinh, Markus Heinonen, Luigi Acerbi, Samuel KaskiNeurIPS 2024 · 8 citations
- In-Memory Neural Network Accelerator based on eDRAM Cell with Enhanced Retention TimeInhwan Lee, Eunhwan Kim, Nameun Kang, Hyunmyung Oh et al.DAC 2023 · 6 citations
