Block-based histogram of optical flow for isolated sign language recognition
- 1 October 2016
- journal article
- Published by Elsevier BV in Journal of Visual Communication and Image Representation
- Vol. 40, 538-545
- https://doi.org/10.1016/j.jvcir.2016.07.020
Abstract
In this paper, we propose a block-based histogram of optical flow (BHOF) to generate hand representation in sign language recognition. Optical flow of the sign language video is computed in a region centered around the location of the detected hand position. The hand patches of optical flow are segmented into M spatial blocks, where each block is a cuboid of a segment of a frame across the entire sign gesture video. The histogram of each block is then computed and normalized by its sum. The feature vector of all blocks are then concatenated as the BHOF sign gesture representation. The proposed method provides a compact scale-invariant representation of the sign language. Furthermore, block-based histogram encodes spatial information and provides local translation invariance in the extracted optical flow. Additionally, the proposed BHOF also introduces sign language length invariancy into its representation, and thereby, produce promising recognition rate in signer independent problemsKeywords
This publication has 20 references indexed in Scilit:
- Efficient Parallel Framework for HEVC Motion Estimation on Many-Core ProcessorsIEEE Transactions on Circuits and Systems for Video Technology, 2014
- Scene Particles: Unregularized Particle-Based Scene Flow EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Weakly Supervised Training of a Sign Language Recognition System Using Multiple Instance Learning Density MatricesIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2010
- Hand gesture recognition based on dynamic Bayesian network frameworkPattern Recognition, 2010
- Signing Exact English (SEE): Modeling and recognitionPattern Recognition, 2007
- Real-time hand tracking using a mean shift embedded particle filterPattern Recognition, 2007
- Large vocabulary sign language recognition based on fuzzy decision treesIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2004
- Extraction of 2D motion trajectories and its application to hand gesture recognitionIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- A dynamic gesture recognition system for the Korean sign language (KSL)IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1996
- Glove-Talk: a neural network interface between a data-glove and a speech synthesizerIEEE Transactions on Neural Networks, 1993