Bayesian Inference Based Robust Computing on Memristor Crossbar
Di Gao, Qingrong Huang, Grace Li Zhang, Xunzhao Yin, Bing Li, Ulf Schlichtmann, Cheng Zhuo
Abstract
Memristor based crossbars are a promising platform for neural network acceleration. To deploy a trained network model on a memristor crossbar, memristors need to be programmed to realize the trained weights of the network. However, due to process and dynamic variations, deviation of weights from the trained value is inevitable and inference accuracy thus degrades. In this paper, we propose a unified Bayesian inference based framework which connects hardware variations and algorithmic training together for robust computing on memristor crossbars. The framework incorporates different levels of variations into priori weight distribution, and transforms robustness optimization to Bayesian neural network training, where weights of neural networks are optimized to accommodate variations and minimize inference degradation. Simulation results with the proposed framework confirm stable inference accuracy under process and dynamic variations.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 009ea546-e2fd-485d-ad5d-3fb760c148f9Related papers
- Pruning of Deep Neural Networks for Fault-Tolerant Memristor-based AcceleratorsChing-Yuan Chen, Krishnendu ChakrabartyDAC 2021 · 24 citations
- Network Insensitivity to Parameter Noise via Parameter Attack During TrainingJulian Büchel, Fynn Firouz Faber, Dylan Richard MuirICLR 2022 · 6 citations
- Write or not: programming scheme optimization for RRAM-based neuromorphic computingZiqi Meng, Yanan Sun, Weikang QianDAC 2022 · 7 citations
- GENIEx: A Generalized Approach to Emulating Non-Ideality in Memristive Xbars using Neural NetworksIndranil Chakraborty, Mustafa Fayez Ali, Dong Eun Kim, Aayush Ankit et al.DAC 2020 · 109 citations
- A Bit More Bayesian: Domain-Invariant Learning with UncertaintyZehao Xiao, Jiayi Shen, Xiantong Zhen, Ling Shao et al.ICML 2021 · 47 citations
