A Comparative Review of Recent Kinect-Based Action Recognition Algorithms
Open Access
- 2 July 2019
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 29 (10577149), 15-28
- https://doi.org/10.1109/tip.2019.2925285
Abstract
Video-based human action recognition is currently one of the most active research areas in computer vision. Various research studies indicate that the performance of action recognition is highly dependent on the type of features being extracted and how the actions are represented. Since the release of the Kinect camera, a large number of Kinect-based human action recognition techniques have been proposed in the literature. However, there still does not exist a thorough comparison of these Kinect-based techniques under the grouping of feature types, such as handcrafted versus deep learning features and depth-based versus skeleton-based features. In this paper, we analyze and compare ten recent Kinect-based algorithms for both cross-subject action recognition and cross-view action recognition using six benchmark datasets. In addition, we have implemented and improved some of these techniques and included their variants in the comparison. Our experiments show that the majority of methods perform better on cross-subject action recognition than cross-view action recognition, that skeleton-based features are more robust for cross-view recognition than depth-based features, and that deep learning features are suitable for large datasets.Keywords
This publication has 71 references indexed in Scilit:
- Discriminative human action classification using locality-constrained linear codingPattern Recognition Letters, 2016
- Learning human activities and object affordances from RGB-D videosThe International Journal of Robotics Research, 2013
- HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth SequencesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Spatio-temporal Depth Cuboid Similarity Feature for Activity Recognition Using Depth CameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- An ‘Object-Use Fingerprint’: The Use of Electronic Sensors for Human IdentificationPublished by Springer Science and Business Media LLC ,2007
- Spatio-temporal Shape and Flow Correlation for Action RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Behavior Recognition via Sparse Spatio-Temporal FeaturesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Hands-On RFID: Wireless Wearables for Detecting Use of ObjectsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- The recognition of human movement using temporal templatesIeee Transactions On Pattern Analysis and Machine Intelligence, 2001
- Long Short-Term MemoryNeural Computation, 1997