COVID-19 detection and disease progression visualization: Deep learning on chest X-rays for classification and coarse localization
Open Access
- 12 September 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in Applied Intelligence
- Vol. 51 (2), 1010-1021
- https://doi.org/10.1007/s10489-020-01867-1
Abstract
Chest X-rays are playing an important role in the testing and diagnosis of COVID-19 disease in the recent pandemic. However, due to the limited amount of labelled medical images, automated classification of these images for positive and negative cases remains the biggest challenge in their reliable use in diagnosis and disease progression. We implemented a transfer learning pipeline for classifying COVID-19 chest X-ray images from two publicly available chest X-ray datasets1,2. The classifier effectively distinguishes inflammation in lungs due to COVID-19 and Pneumonia from the ones with no infection (normal). We have used multiple pre-trained convolutional backbones as the feature extractor and achieved an overall detection accuracy of 90%, 94.3%, and 96.8% for the VGG16, ResNet50, and EfficientNetB0 backbones respectively. Additionally, we trained a generative adversarial framework (a CycleGAN) to generate and augment the minority COVID-19 class in our approach. For visual explanations and interpretation purposes, we implemented a gradient class activation mapping technique to highlight the regions of the input image that are important for predictions. Additionally, these visualizations can be used to monitor the affected lung regions during disease progression and severity stages.Keywords
Funding Information
- not applicable
This publication has 22 references indexed in Scilit:
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationInternational Journal of Computer Vision, 2019
- Design and Implementation of a Convolutional Neural Network on an Edge Computing Smartphone for Human Activity RecognitionIEEE Access, 2019
- A survey on Image Data Augmentation for Deep LearningJournal of Big Data, 2019
- An Efficient Deep Learning Approach to Pneumonia Classification in HealthcareJournal of Healthcare Engineering, 2019
- Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional studyPLoS Medicine, 2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial NetworksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Deep Residual Learning for Image RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Two public chest X-ray datasets for computer-aided screening of pulmonary diseases2014
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009