Extraction of 2D motion trajectories and its application to hand gesture recognition
- 7 November 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Ieee Transactions On Pattern Analysis and Machine Intelligence
- Vol. 24 (8), 1061-1074
- https://doi.org/10.1109/tpami.2002.1023803
Abstract
We present an algorithm for extracting and classifying two-dimensional motion in an image sequence based on motion trajectories. First, a multiscale segmentation is performed to generate homogeneous regions in each frame. Regions between consecutive frames are then matched to obtain two-view correspondences. Affine transformations are computed from each pair of corresponding regions to define pixel matches. Pixels matches over consecutive image pairs are concatenated to obtain pixel-level motion trajectories across the image sequence. Motion patterns are learned from the extracted trajectories using a time-delay neural network. We apply the proposed method to recognize 40 hand gestures of American Sign Language. Experimental results show that motion patterns of hand gestures can be extracted and recognized accurately using motion trajectories.Keywords
This publication has 39 references indexed in Scilit:
- Segmentation as the search for the best description of the image in terms of primitivesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust segmentation of primitives from range data in the presence of geometric degeneracyIeee Transactions On Pattern Analysis and Machine Intelligence, 2001
- An HMM-based threshold model approach for gesture recognitionIeee Transactions On Pattern Analysis and Machine Intelligence, 1999
- Parametric hidden Markov models for gesture recognitionIeee Transactions On Pattern Analysis and Machine Intelligence, 1999
- Human Motion Analysis: A ReviewComputer Vision and Image Understanding, 1999
- A state-based approach to the representation and recognition of gestureIeee Transactions On Pattern Analysis and Machine Intelligence, 1997
- Matching two perspective viewsIeee Transactions On Pattern Analysis and Machine Intelligence, 1992
- Displacement vectors derived from second-order intensity variations in image sequencesComputer Vision, Graphics, and Image Processing, 1983
- Perception of American Sign Language in dynamic point-light displays.Journal of Experimental Psychology: Human Perception and Performance, 1981
- Disparity Analysis of ImagesIeee Transactions On Pattern Analysis and Machine Intelligence, 1980