TFix: Exploiting the Natural Redundancy of Ternary Neural Networks for Fault Tolerant In-Memory Vector Matrix Multiplication
Akul Malhotra, Chunguang Wang, Sumeet Kumar Gupta
2023年份
4被引次数
摘要
In-memory computing (IMC) and quantization have emerged as promising techniques for edge-based deep neural network (DNN) accelerators by reducing their energy, latency and storage requirements. In pursuit of ultra-low precision, ternary precision DNNs (TDNNs) offer high efficiency without sacrificing much inference accuracy. In this work, we explore the impact of hard faults on IMC based TDNNs and propose TFix to enhance their fault tolerance. TFix exploits the natural redundancy present in most ternary IMC bitcells as well as the high weight sparsity in TDNNs to provide up to 40.68% accuracy increase over the baseline with < 6% energy overhead.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Towards Memory-Efficient Neural Networks via Multi-Level in situ GenerationJiaqi Gu, Hanqing Zhu, Chenghao Feng, Mingjie Liu 等ICCV 2021 · 被引用 4 次
- TAIM: ternary activation in-memory computing hardware with 6T SRAM arrayNameun Kang, Hyungjun Kim, Hyunmyung Oh, Jae-Joon KimDAC 2022 · 被引用 4 次
- Pruning of Deep Neural Networks for Fault-Tolerant Memristor-based AcceleratorsChing-Yuan Chen, Krishnendu ChakrabartyDAC 2021 · 被引用 24 次
- Low-Cost and Effective Fault-Tolerance Enhancement Techniques for Emerging Memories-Based Deep Neural NetworksThai-Hoang Nguyen, Muhammad Imran, Jaehyuk Choi, Joon-Sung YangDAC 2021 · 被引用 13 次
- Leveraging Noise and Aggressive Quantization of In-Memory Computing for Robust DNN Hardware Against Adversarial Input and Weight AttacksSai Kiran Cherupally, Adnan Siraj Rakin, Shihui Yin, Mingoo Seok 等DAC 2021 · 被引用 10 次
