Action Recognition Using a Spatial-Temporal Network for Wild Felines
Open Access
- 12 February 2021
- Vol. 11 (2), 485
- https://doi.org/10.3390/ani11020485
Abstract
Behavior analysis of wild felines has significance for the protection of a grassland ecological environment. Compared with human action recognition, fewer researchers have focused on feline behavior analysis. This paper proposes a novel two-stream architecture that incorporates spatial and temporal networks for wild feline action recognition. The spatial portion outlines the object region extracted by Mask region-based convolutional neural network (R-CNN) and builds a Tiny Visual Geometry Group (VGG) network for static action recognition. Compared with VGG16, the Tiny VGG network can reduce the number of network parameters and avoid overfitting. The temporal part presents a novel skeleton-based action recognition model based on the bending angle fluctuation amplitude of the knee joints in a video clip. Due to its temporal features, the model can effectively distinguish between different upright actions, such as standing, ambling, and galloping, particularly when the felines are occluded by objects such as plants, fallen trees, and so on. The experimental results showed that the proposed two-stream network model can effectively outline the wild feline targets in captured images and can significantly improve the performance of wild feline action recognition due to its spatial and temporal features.Keywords
Funding Information
- National Natural Science Fund (No.31200496)
This publication has 45 references indexed in Scilit:
- LSTM: A Search Space OdysseyIEEE Transactions on Neural Networks and Learning Systems, 2016
- Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth SensorSensors, 2016
- Behavioural analysis of captive tigers (Panthera tigris): A water pool makes the differenceApplied Animal Behaviour Science, 2015
- Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savannaScientific Data, 2015
- The Science of Animal Behavior and Welfare: Challenges, Opportunities, and Global PerspectiveFrontiers in Veterinary Science, 2015
- A New Decade of Veterinary Research: Societal Relevance, Global Collaboration, and Translational MedicineFrontiers in Veterinary Science, 2015
- Toward a Science of Computational EthologyNeuron, 2014
- Animal-mounted gyroscope/accelerometer/magnetometer: In situ measurement of the movement performance of fast-start behaviour in fishJournal of Experimental Marine Biology and Ecology, 2014
- Why It Is Important to Understand Animal BehaviorILAR Journal, 1998
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996