An Early Resource Characterization of Deep Learning on Wearables, Smartphones and Internet-of-Things Devices
- 1 November 2015
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
Detecting and reacting to user behavior and ambient context are core elements of many emerging mobile sensing and Internet-of-Things (IoT) applications. However, extracting accurate inferences from raw sensor data is challenging within the noisy and complex environments where these systems are deployed. Deep Learning -- is one of the most promising approaches for overcoming this challenge, and achieving more robust and reliable inference. Techniques developed within this rapidly evolving area of machine learning are now state-of-the-art for many inference tasks (such as, audio sensing and computer vision) commonly needed by IoT and wearable applications. But currently deep learning algorithms are seldom used in mobile/IoT class hardware because they often impose debilitating levels of system overhead (e.g., memory, computation and energy). Efforts to address this barrier to deep learning adoption are slowed by our lack of a systematic understanding of how these algorithms behave at inference time on resource constrained hardware. In this paper, we present the first -- albeit preliminary -- measurement study of common deep learning models (such as Convolutional Neural Networks and Deep Neural Networks) on representative mobile and embedded platforms. The aim of this investigation is to begin to build knowledge of the performance characteristics, resource requirements and the execution bottlenecks for deep learning models when being used to recognize categories of behavior and context. The results and insights of this study, lay an empirical foundation for the development of optimization methods and execution environments that enable deep learning to be more readily integrated into next-generation IoT, smartphones and wearable systems.Keywords
This publication has 10 references indexed in Scilit:
- DeepEarPublished by Association for Computing Machinery (ACM) ,2015
- ZOEPublished by Association for Computing Machinery (ACM) ,2015
- Can Deep Learning Revolutionize Mobile Sensing?Published by Association for Computing Machinery (ACM) ,2015
- DSP.EarPublished by Association for Computing Machinery (ACM) ,2014
- Enabling physical analytics in retail stores using smart glassesPublished by Association for Computing Machinery (ACM) ,2014
- DeepFace: Closing the Gap to Human-Level Performance in Face VerificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- DianNaoACM SIGPLAN Notices, 2014
- Energy characterization and optimization of image sensing toward continuous mobile visionPublished by Association for Computing Machinery (ACM) ,2013
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- Passive and In-Situ assessment of mental and physical well-being using mobile sensorsPublished by Association for Computing Machinery (ACM) ,2011