Face with Mask Detection in Thermal Images Using Deep Neural Networks
Open Access
- 24 September 2021
- Vol. 21 (19), 6387
- https://doi.org/10.3390/s21196387
Abstract
As the interest in facial detection grows, especially during a pandemic, solutions are sought that will be effective and bring more benefits. This is the case with the use of thermal imaging, which is resistant to environmental factors and makes it possible, for example, to determine the temperature based on the detected face, which brings new perspectives and opportunities to use such an approach for health control purposes. The goal of this work is to analyze the effectiveness of deep-learning-based face detection algorithms applied to thermal images, especially for faces covered by virus protective face masks. As part of this work, a set of thermal images was prepared containing over 7900 images of faces with and without masks. Selected raw data preprocessing methods were also investigated to analyze their influence on the face detection results. It was shown that the use of transfer learning based on features learned from visible light images results in mAP greater than 82% for half of the investigated models. The best model turned out to be the one based on Yolov3 model (mean average precision—mAP, was at least 99.3%, while the precision was at least 66.1%). Inference time of the models selected for evaluation on a small and cheap platform allows them to be used for many applications, especially in apps that promote public health.Keywords
This publication has 17 references indexed in Scilit:
- Occurrence of the potent mutagens 2- nitrobenzanthrone and 3-nitrobenzanthrone in fine airborne particlesScientific Reports, 2019
- Face Detection in Thermal Infrared Images: A Comparison of Algorithm- and Machine-Learning-Based ApproachesPublished by Springer Science and Business Media LLC ,2017
- Evaluation of Respiration Rate Using Thermal Imaging in Mobile ConditionsPublished by Springer Science and Business Media LLC ,2017
- NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face IdentificationInformation, 2016
- Analysis of the parameters of respiration patterns extracted from thermal image sequencesBiocybernetics and Biomedical Engineering, 2016
- Rethinking the Inception Architecture for Computer VisionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- WIDER FACE: A Face Detection BenchmarkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- RGB-D-T Based Face RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Illumination Invariant Face Recognition Using Near-Infrared ImagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004