TFix: Exploiting the Natural Redundancy of Ternary Neural Networks for Fault Tolerant In-Memory Vector Matrix Multiplication
Akul Malhotra, Chunguang Wang, Sumeet Kumar Gupta
Abstract
In-memory computing (IMC) and quantization have emerged as promising techniques for edge-based deep neural network (DNN) accelerators by reducing their energy, latency and storage requirements. In pursuit of ultra-low precision, ternary precision DNNs (TDNNs) offer high efficiency without sacrificing much inference accuracy. In this work, we explore the impact of hard faults on IMC based TDNNs and propose TFix to enhance their fault tolerance. TFix exploits the natural redundancy present in most ternary IMC bitcells as well as the high weight sparsity in TDNNs to provide up to 40.68% accuracy increase over the baseline with < 6% energy overhead.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get eec725bb-b35e-40cc-95e0-db2d641167b5Related papers
- Towards Memory-Efficient Neural Networks via Multi-Level in situ GenerationJiaqi Gu, Hanqing Zhu, Chenghao Feng, Mingjie Liu et al.ICCV 2021 · 4 citations
- TAIM: ternary activation in-memory computing hardware with 6T SRAM arrayNameun Kang, Hyungjun Kim, Hyunmyung Oh, Jae-Joon KimDAC 2022 · 4 citations
- Pruning of Deep Neural Networks for Fault-Tolerant Memristor-based AcceleratorsChing-Yuan Chen, Krishnendu ChakrabartyDAC 2021 · 24 citations
- Low-Cost and Effective Fault-Tolerance Enhancement Techniques for Emerging Memories-Based Deep Neural NetworksThai-Hoang Nguyen, Muhammad Imran, Jaehyuk Choi, Joon-Sung YangDAC 2021 · 13 citations
- Leveraging Noise and Aggressive Quantization of In-Memory Computing for Robust DNN Hardware Against Adversarial Input and Weight AttacksSai Kiran Cherupally, Adnan Siraj Rakin, Shihui Yin, Mingoo Seok et al.DAC 2021 · 10 citations
