Automatic Neonatal Alertness State Classification Based on Facial Expression Recognition
Open Access
- 20 March 2022
- journal article
- Published by Fuji Technology Press Ltd. in Journal of Advanced Computational Intelligence and Intelligent Informatics
- Vol. 26 (2), 188-195
- https://doi.org/10.20965/jaciii.2022.p0188
Abstract
Premature babies are admitted to the neonatal intensive care unit (NICU) for several weeks and are generally placed under high medical supervision. The NICU environment is considered to have a bad influence on the formation of the sleep-wake cycle of the neonate, known as the circadian rhythm, because patient monitoring and treatment equipment emit light and noise throughout the day. In order to improve the neonatal environment, researchers have investigated the effect of light and noise on neonates. There are some methods and devices to measure neonatal alertness, but they place on additional burden on neonatal patients or nurses. Therefore, this study proposes an automatic non-contact neonatal alertness state classification method using video images. The proposed method consists of a face region of interest (ROI) location normalization method, histogram of oriented gradients (HOG) and gradient feature-based feature extraction methods, and a neonatal alertness state classification method using machine learning. Comparison experiments using 14 video images of 7 neonatal subjects showed that the weighted support vector machine (w-SVM) using the HOG feature and averaging merge achieved the highest classification performance (micro-F1 of 0.732). In clinical situations, body movement is evaluated primarily to classify waking states. The additional 4 class classification experiments are conducted by combining waking states into a single class, with results that suggest that the proposed facial expression based classification is suitable for the detailed classification of sleeping states.Keywords
Funding Information
- Japan Society for the Promotion of Science (21K12704)
This publication has 10 references indexed in Scilit:
- Audio- and video-based estimation of the sleep stages of newborns in Neonatal Intensive Care UnitBiomedical Signal Processing and Control, 2019
- A survey on sleep assessment methodsPeerJ, 2018
- National, regional, and worldwide estimates of preterm birth rates in the year 2010 with time trends since 1990 for selected countries: a systematic analysis and implicationsThe Lancet, 2012
- Validation of actigraphy for determining sleep and wake in preterm infantsActa Paediatrica, 2008
- Handwritten numeral recognition using gradient and curvature of gray scale imagePattern Recognition, 2002
- Environmental impact of the NICU on developmental outcomesJournal of Pediatric Nursing, 1998
- Increasing the feature size in handwritten numeral recognition to improve accuracySystems and Computers in Japan, 1995
- Automatic Sleep/Wake Identification From Wrist ActivitySleep, 1992
- Utilization of Polysomnography in the Assessment of Sleep DisordersMedical Clinics of North America, 1985
- The behavioural states of the newborn infant (a review)Brain Research, 1974