Probabilistic Spike Propagation for Efficient Hardware Implementation of Spiking Neural Networks
Open Access
- 15 July 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 15, 694402
- https://doi.org/10.3389/fnins.2021.694402
Abstract
Spiking neural networks (SNNs) have gained considerable attention in recent years due to their ability to model temporal event streams, be trained using unsupervised learning rules, and be realized on low-power event-driven hardware. Notwithstanding the intrinsic desirable attributes of SNNs, there is a need to further optimize their computational efficiency to enable their deployment in highly resource-constrained systems. The complexity of evaluating an SNN is strongly correlated to the spiking activity in the network, and can be measured in terms of a fundamental unit of computation, viz. spike propagation along a synapse from a single source neuron to a single target neuron. We propose probabilistic spike propagation, an approach to optimize rate-coded SNNs by interpreting synaptic weights as probabilities, and utilizing these probabilities to regulate spike propagation. The approach results in 2.4–3.69× reduction in spikes propagated, leading to reduced time and energy consumption. We propose Probabilistic Spiking Neural Network Application Processor (P-SNNAP), a specialized SNN accelerator with support for probabilistic spike propagation. Our evaluations across a suite of benchmark SNNs demonstrate that probabilistic spike propagation results in 1.39–2× energy reduction with simultaneous speedups of 1.16–1.62× compared to the traditional model of SNN evaluation.This publication has 42 references indexed in Scilit:
- TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic ChipIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2015
- Unsupervised learning of digit recognition using spike-timing-dependent plasticityFrontiers in Computational Neuroscience, 2015
- Memristors Empower Spiking Neurons With StochasticityIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2015
- The SpiNNaker ProjectProceedings of the IEEE, 2014
- STDP and STDP variations with memristors for spiking neuromorphic learning systemsFrontiers in Neuroscience, 2013
- To spike or not to spike: A probabilistic spiking neuron modelNeural Networks, 2010
- Bayesian Spiking Neurons I: InferenceNeural Computation, 2008
- Rare-Event SimulationPublished by Springer Science and Business Media LLC ,2007
- Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic TransmissionNeuron, 2003
- Networks of spiking neurons: The third generation of neural network modelsNeural Networks, 1997