Towards Machine Recognition of Facial Expressions of Pain in Horses
Open Access
- 1 June 2021
- Vol. 11 (6), 1643
- https://doi.org/10.3390/ani11061643
Abstract
Automated recognition of human facial expressions of pain and emotions is to a certain degree a solved problem, using approaches based on computer vision and machine learning. However, the application of such methods to horses has proven difficult. Major barriers are the lack of sufficiently large, annotated databases for horses and difficulties in obtaining correct classifications of pain because horses are non-verbal. This review describes our work to overcome these barriers, using two different approaches. One involves the use of a manual, but relatively objective, classification system for facial activity (Facial Action Coding System), where data are analyzed for pain expressions after coding using machine learning principles. We have devised tools that can aid manual labeling by identifying the faces and facial keypoints of horses. This approach provides promising results in the automated recognition of facial action units from images. The second approach, recurrent neural network end-to-end learning, requires less extraction of features and representations from the video but instead depends on large volumes of video data with ground truth. Our preliminary results suggest clearly that dynamics are important for pain recognition and show that combinations of recurrent neural networks can classify experimental pain in a small number of horses better than human raters.Keywords
Funding Information
- Svenska Forskningsrådet Formas (2020-01840 and 2016-01760)
- Vetenskapsrådet (2016-03967)
This publication has 105 references indexed in Scilit:
- Towards an Ethological Animal Model of Depression? A Study on HorsesPLOS ONE, 2012
- The effects of age and sex on pain sensitivity in young lambsApplied Animal Behaviour Science, 2011
- Video quality for face detection, recognition, and trackingACM Transactions on Multimedia Computing, Communications, and Applications, 2011
- MRI structural brain changes associated with sensory and emotional function in a rat model of long-term neuropathic painNeuroImage, 2009
- Development of a composite orthopaedic pain scale in horsesResearch in Veterinary Science, 2008
- Mapping the contribution of single muscles to facial movements in the rhesus macaquePhysiology & Behavior, 2008
- A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)Journal of Nonverbal Behavior, 2006
- Behavioural and neurophysiological evidence for face identity and face emotion processing in animalsPhilosophical Transactions B, 2006
- Intramuscular electrical stimulation of facial muscles in humans and chimpanzees: Duchenne revisited and extended.Emotion, 2006
- Current British veterinary attitudes to perioperative analgesia for dogsVeterinary Record, 1999