Mixed-precision weights network for field-programmable gate array
Open Access
- 10 May 2021
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 16 (5), e0251329
- https://doi.org/10.1371/journal.pone.0251329
Abstract
In this study, we introduced a mixed-precision weights network (MPWN), which is a quantization neural network that jointly utilizes three different weight spaces: binary {−1,1}, ternary {−1,0,1}, and 32-bit floating-point. We further developed the MPWN from both software and hardware aspects. From the software aspect, we evaluated the MPWN on the Fashion-MNIST and CIFAR10 datasets. We systematized the accuracy sparsity bit score, which is a linear combination of accuracy, sparsity, and number of bits. This score allows Bayesian optimization to be used efficiently to search for MPWN weight space combinations. From the hardware aspect, we proposed XOR signed-bits to explore floating-point and binary weight spaces in the MPWN. XOR signed-bits is an efficient implementation equivalent to multiplication of floating-point and binary weight spaces. Using the concept from XOR signed bits, we also provide a ternary bitwise operation that is an efficient implementation equivalent to the multiplication of floating-point and ternary weight space. To demonstrate the compatibility of the MPWN with hardware implementation, we synthesized and implemented the MPWN in a field-programmable gate array using high-level synthesis. Our proposed MPWN implementation utilized up to 1.68-4.89 times less hardware resources depending on the type of resources than a conventional 32-bit floating-point model. In addition, our implementation reduced the latency up to 31.55 times compared to 32-bit floating-point model without optimizations.Funding Information
- Japan Society for the Promotion of Science (17K20010)
This publication has 20 references indexed in Scilit:
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image SegmentationPublished by Springer Science and Business Media LLC ,2018
- A Lightweight YOLOv2Published by Association for Computing Machinery (ACM) ,2018
- Deep Cross-Modal Audio-Visual GenerationPublished by Association for Computing Machinery (ACM) ,2017
- A demonstration of the GUINNESS: A GUI based neural NEtwork SyntheSizer for an FPGAPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- YOLO9000: Better, Faster, StrongerPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- FINNPublished by Association for Computing Machinery (ACM) ,2017
- Deep Residual Learning for Image RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998