Practical Mechanism for Fault-Tolerant Spiking Neural Networks via Simple Input Control Based on Learnable Fragmentation
Hyun-Jong Lee, Jae-Han Lim
摘要
Spiking Neural Networks (SNNs) are regarded as the third generation of neural networks, offering energy-efficient computing for neuromorphic devices. Despite this benefit, hardware-implemented SNNs are vulnerable to hardware faults, which severely degrade their performance. Previous approaches have required direct access to internal SNN circuits to modify weights or monitor internal states, limiting their practicality. Improving robustness to hardware faults without such access remains challenging. To overcome this challenge, we propose a fault-tolerant mechanism that operates only through input data control. Hardware faults reduce the usable learning capacity of SNNs, resulting in a mismatch between the instantaneous input load and the degraded network dynamics. Our mechanism mitigates this mismatch by dividing each input sample into multiple fragments, redistributing the input load via a learnable fragmentation strategy. The strategy learns two key fragmentation components: 1) division boundaries and 2) the number of fragments. To our knowledge, this is the first mechanism to improve the fault tolerance of SNNs without accessing the internal circuits. Experimental results demonstrate that our mechanism consistently outperforms previous methods in various SNN models, achieving these gains without direct access to internal circuits. Furthermore, we validate its effectiveness on SNNs implemented with a physical FPGA platform, confirming its practicality.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- SEENN: Towards Temporal Spiking Early Exit Neural NetworksYuhang Li, Tamar Geller, Youngeun Kim, Priyadarshini PandaNeurIPS 2023 · 被引用 82 次
- RecDis-SNN: Rectifying Membrane Potential Distribution for Directly Training Spiking Neural NetworksYufei Guo, Xinyi Tong, Yuanpei Chen, Liwen Zhang 等CVPR 2022 · 被引用 73 次
- Membrane Potential Batch Normalization for Spiking Neural NetworksYufei Guo, Yuhan Zhang, Yuanpei Chen, Weihang Peng 等ICCV 2023 · 被引用 62 次
- TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential ModellingShimin Zhang, Qu Yang, Chenxiang Ma, Jibin Wu 等AAAI 2024 · 被引用 51 次
- Pruning of Deep Neural Networks for Fault-Tolerant Memristor-based AcceleratorsChing-Yuan Chen, Krishnendu ChakrabartyDAC 2021 · 被引用 24 次
相关 Paper
- SoftSNN: low-cost fault tolerance for spiking neural network accelerators under soft errorsRachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad ShafiqueDAC 2022 · 被引用 3 次
- HardF-SNN: Hardware-Friendly Quantization for Spiking Neural Networks with Efficient Integer-Arithmetic-Only InferenceHanwen Liu, Kexin Shi, Jieyuan Zhang, Yimeng Shan 等AAAI 2026
- Enhancing the Robustness of Spiking Neural Networks with Stochastic Gating MechanismsJianhao Ding, Zhaofei Yu, Tiejun Huang, Jian K. LiuAAAI 2024 · 被引用 23 次
- SparkXD: A Framework for Resilient and Energy-Efficient Spiking Neural Network Inference using Approximate DRAMRachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad ShafiqueDAC 2021 · 被引用 28 次
- Enhancing Adversarial Robustness in SNNs with Sparse GradientsYujia Liu, Tong Bu, Jianhao Ding, Zecheng Hao 等ICML 2024 · 被引用 17 次
