A Comprehensive Study on Deep Learning-Based 3D Hand Pose Estimation Methods
Open Access
- 30 September 2020
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 10 (19), 6850
- https://doi.org/10.3390/app10196850
Abstract
The field of 3D hand pose estimation has been gaining a lot of attention recently, due to its significance in several applications that require human-computer interaction (HCI). The utilization of technological advances, such as cost-efficient depth cameras coupled with the explosive progress of Deep Neural Networks (DNNs), has led to a significant boost in the development of robust markerless 3D hand pose estimation methods. Nonetheless, finger occlusions and rapid motions still pose significant challenges to the accuracy of such methods. In this survey, we provide a comprehensive study of the most representative deep learning-based methods in literature and propose a new taxonomy heavily based on the input data modality, being RGB, depth, or multimodal information. Finally, we demonstrate results on the most popular RGB and depth-based datasets and discuss potential research directions in this rapidly growing field.Keywords
This publication has 85 references indexed in Scilit:
- 3D Finger CAPE: Clicking Action and Position Estimation under Self-Occlusions in Egocentric ViewpointIEEE Transactions on Visualization and Computer Graphics, 2015
- Real-Time Continuous Pose Recovery of Human Hands Using Convolutional NetworksACM Transactions on Graphics, 2014
- Quaternionic Signal Processing Techniques for Automatic Evaluation of Dance Performances From MoCap DataIEEE Transactions on Multimedia, 2014
- Parsing the Hand in Depth ImagesIEEE Transactions on Multimedia, 2014
- Model-based hand pose estimation via spatial-temporal hand parsing and 3D fingertip localizationThe Visual Computer, 2013
- Optimizing walking controllersACM Transactions on Graphics, 2009
- Real-time hand-tracking with a color gloveACM Transactions on Graphics, 2009
- Vision-based hand pose estimation: A reviewComputer Vision and Image Understanding, 2007
- Kohonen networkScholarpedia, 2007
- Long Short-Term MemoryNeural Computation, 1997