Efficient Techniques for Training the Memristor-based Spiking Neural Networks Targeting Better Speed, Energy and Lifetime
- 18 January 2021
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM) in Proceedings of the 26th Asia and South Pacific Design Automation Conference
Abstract
Speed and energy consumption are two important metrics in designing spiking neural networks (SNNs). The inference process of current SNNs is terminated after a preset number of time steps for all images, which leads to a waste of time and spikes. We can terminate the inference process after proper number of time steps for each image. Besides, normalization method also influences the time and spikes of SNNs. In this work, we first use reinforcement learning algorithm to develop an efficient termination strategy which can help find the right number of time steps for each image. Then we propose a model tuning technique for memristor-based crossbar circuit to optimize the weight and bias of a given SNN. Experimental results show that the proposed techniques can reduce about 58.7% crossbar energy consumption and over 62.5% time consumption and double the drift lifetime of memristor-based SNN.Keywords
This publication has 9 references indexed in Scilit:
- Deep learning in spiking neural networksNeural Networks, 2018
- Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image ClassificationFrontiers in Neuroscience, 2017
- Training Deep Spiking Neural Networks Using BackpropagationFrontiers in Neuroscience, 2016
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- State Dynamics and Modeling of Tantalum Oxide MemristorsIEEE Transactions on Electron Devices, 2013
- Spike-Timing-Dependent Plasticity: A Comprehensive OverviewFrontiers in Synaptic Neuroscience, 2012
- Short-Term Memory to Long-Term Memory Transition in a Nanoscale MemristorACS Nano, 2011
- Memristor-The missing circuit elementIEEE Transactions on Circuit Theory, 1971
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958