Recognising action as clouds of space-time interest points
- 1 June 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1948-1955
- https://doi.org/10.1109/cvpr.2009.5206779
Abstract
Much of recent action recognition research is based on space-time interest points extracted from video using a Bag of Words (BOW) representation. It mainly relies on the discriminative power of individual local space-time descriptors, whilst ignoring potentially valuable information about the global spatio-temporal distribution of interest points. In this paper, we propose a novel action recognition approach which differs significantly from previous interest points based approaches in that only the global spatiotemporal distribution of the interest points are exploited. This is achieved through extracting holistic features from clouds of interest points accumulated over multiple temporal scales followed by automatic feature selection. Our approach avoids the non-trivial problems of selecting the optimal space-time descriptor, clustering algorithm for constructing a codebook, and selecting codebook size faced by previous interest points based methods. Our model is able to capture smooth motions, robust to view changes and occlusions at a low computation cost. Experiments using the KTH and WEIZMANN datasets demonstrate that our approach outperforms most existing methods.Keywords
This publication has 18 references indexed in Scilit:
- Unsupervised Learning of Human Action Categories Using Spatial-Temporal WordsInternational Journal of Computer Vision, 2008
- Information Theoretic Key Frame Selection for Action RecognitionPublished by British Machine Vision Association and Society for Pattern Recognition ,2008
- Spatial-Temporal correlatons for unsupervised action classificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Discriminative Subsequence Mining for Action ClassificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Behavior Recognition via Sparse Spatio-Temporal FeaturesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- View-invariance in action recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Actions Sketch: A Novel Action RepresentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancyIeee Transactions On Pattern Analysis and Machine Intelligence, 2005
- Exploring the space of a human actionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Recognizing human actions: a local SVM approachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004