Explainable Image Quality Assessments in Teledermatological Photography
Open Access
- 1 September 2023
- journal article
- research article
- Published by Mary Ann Liebert Inc in Telemedicine and e-Health
- Vol. 29 (9), 1342-1348
- https://doi.org/10.1089/tmj.2022.0405
Abstract
Background and Objectives: Image quality is a crucial factor in the effectiveness and efficiency of teledermatological consultations. However, up to 50% of images sent by patients have quality issues, thus increasing the time to diagnosis and treatment. An automated, easily deployable, explainable method for assessing image quality is necessary to improve the current teledermatological consultation flow. We introduce ImageQX, a convolutional neural network for image quality assessment with a learning mechanism for identifying the most common poor image quality explanations: bad framing, bad lighting, blur, low resolution, and distance issues. Methods: ImageQX was trained on 26,635 photographs and validated on 9,874 photographs, each annotated with image quality labels and poor image quality explanations by up to 12 board-certified dermatologists. The photographic images were taken between 2017 and 2019 using a mobile skin disease tracking application accessible worldwide. Results: Our method achieves expert-level performance for both image quality assessment and poor image quality explanation. For image quality assessment, ImageQX obtains a macro F1-score of 0.73 ± 0.01, which places it within standard deviation of the pairwise inter-rater F1-score of 0.77 ± 0.07. For poor image quality explanations, our method obtains F1-scores of between 0.37 ± 0.01 and 0.70 ± 0.01, similar to the inter-rater pairwise F1-score of between 0.24 ± 0.15 and 0.83 ± 0.06. Moreover, with a size of only 15 MB, ImageQX is easily deployable on mobile devices. Conclusion: With an image quality detection performance similar to that of dermatologists, incorporating ImageQX into the teledermatology flow can enable a better, faster flow for remote consultations.Keywords
This publication has 17 references indexed in Scilit:
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationInternational Journal of Computer Vision, 2019
- Association of mutations in the Plasmodium falciparum Kelch13 gene (Pf3D7_1343700) with parasite clearance rates after artemisinin-based treatments—a WWARN individual patient data meta-analysisBMC Medicine, 2019
- High-performance medicine: the convergence of human and artificial intelligenceNature Medicine, 2019
- Performance evaluation of image denoising developed using convolutional denoising autoencoders in chest radiographyNuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- On the use of deep learning for blind image quality assessmentSignal, Image and Video Processing, 2017
- Deep Learning of Human Visual Sensitivity in Image Quality Assessment FrameworkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Crowdsourced study of subjective image qualityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Teledermatology: Key factors associated with reducing face-to-face dermatology visitsJournal of the American Academy of Dermatology, 2014
- ImageNet: A large-scale hierarchical image databasePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009