Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices
Top Cited Papers
- 11 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
- Vol. 9 (2), 292-308
- https://doi.org/10.1109/jetcas.2019.2910232
Abstract
A recent trend in deep neural network (DNN) development is to extend the reach of deep learning applications to platforms that are more resource and energy-constrained, e.g., mobile devices. These endeavors aim to reduce the DNN model size and improve the hardware processing efficiency and have resulted in DNNs that are much more compact in their structures and/or have high data sparsity . These compact or sparse models are different from the traditional large ones in that there is much more variation in their layer shapes and sizes and often require specialized hardware to exploit sparsity for performance improvement. Therefore, many DNN accelerators designed for large DNNs do not perform well on these models. In this paper, we present Eyeriss v2, a DNN accelerator architecture designed for running compact and sparse DNNs. To deal with the widely varying layer shapes and sizes, it introduces a highly flexible on-chip network, called hierarchical mesh, that can adapt to the different amounts of data reuse and bandwidth requirements of different data types, which improves the utilization of the computation resources. Furthermore, Eyeriss v2 can process sparse data directly in the compressed domain for both weights and activations and therefore is able to improve both processing speed and energy efficiency with sparse models. Overall, with sparse MobileNet, Eyeriss v2 in a 65-nm CMOS process achieves a throughput of 1470.6 inferences/s and 2560.3 inferences/J at a batch size of 1, which is $12.6\times $ faster and $2.5\times $ more energy-efficient than the original Eyeriss running MobileNet.
Keywords
Funding Information
- Defense Advanced Research Projects Agency
This publication has 36 references indexed in Scilit:
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- EyerissACM SIGARCH Computer Architecture News, 2016
- EIEACM SIGARCH Computer Architecture News, 2016
- ProteusPublished by Association for Computing Machinery (ACM) ,2016
- Energy-efficient ConvNets through approximate computingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- FlowNet: Learning Optical Flow with Convolutional NetworksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Learning Deconvolution Network for Semantic SegmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- ShiDianNaoPublished by Association for Computing Machinery (ACM) ,2015
- Going deeper with convolutionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015