Bayesian Inference Based Robust Computing on Memristor Crossbar
Di Gao, Qingrong Huang, Grace Li Zhang, Xunzhao Yin, Bing Li, Ulf Schlichtmann, Cheng Zhuo
摘要
Memristor based crossbars are a promising platform for neural network acceleration. To deploy a trained network model on a memristor crossbar, memristors need to be programmed to realize the trained weights of the network. However, due to process and dynamic variations, deviation of weights from the trained value is inevitable and inference accuracy thus degrades. In this paper, we propose a unified Bayesian inference based framework which connects hardware variations and algorithmic training together for robust computing on memristor crossbars. The framework incorporates different levels of variations into priori weight distribution, and transforms robustness optimization to Bayesian neural network training, where weights of neural networks are optimized to accommodate variations and minimize inference degradation. Simulation results with the proposed framework confirm stable inference accuracy under process and dynamic variations.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Pruning of Deep Neural Networks for Fault-Tolerant Memristor-based AcceleratorsChing-Yuan Chen, Krishnendu ChakrabartyDAC 2021 · 被引用 24 次
- Network Insensitivity to Parameter Noise via Parameter Attack During TrainingJulian Büchel, Fynn Firouz Faber, Dylan Richard MuirICLR 2022 · 被引用 6 次
- Write or not: programming scheme optimization for RRAM-based neuromorphic computingZiqi Meng, Yanan Sun, Weikang QianDAC 2022 · 被引用 7 次
- GENIEx: A Generalized Approach to Emulating Non-Ideality in Memristive Xbars using Neural NetworksIndranil Chakraborty, Mustafa Fayez Ali, Dong Eun Kim, Aayush Ankit 等DAC 2020 · 被引用 109 次
- A Bit More Bayesian: Domain-Invariant Learning with UncertaintyZehao Xiao, Jiayi Shen, Xiantong Zhen, Ling Shao 等ICML 2021 · 被引用 47 次
