Human–computer collaboration for skin cancer recognition
Top Cited Papers
Open Access
- 22 June 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in Nature Medicine
- Vol. 26 (8), 1229-1234
- https://doi.org/10.1038/s41591-020-0942-0
Abstract
The rapid increase in telemedicine coupled with recent advances in diagnostic artificial intelligence (AI) create the imperative to consider the opportunities and risks of inserting AI-based support into new paradigms of care. Here we build on recent achievements in the accuracy of image-based AI for skin cancer diagnosis to address the effects of varied representations of AI-based support across different levels of clinical expertise and multiple clinical workflows. We find that good quality AI-based support of clinical decision-making improves diagnostic accuracy over that of either AI or physicians alone, and that the least experienced clinicians gain the most from AI-based support. We further find that AI-based multiclass probabilities outperformed content-based image retrieval (CBIR) representations of AI in the mobile technology environment, and AI-based support had utility in simulations of second opinions and of telemedicine triage. In addition to demonstrating the potential benefits associated with good quality AI in the hands of non-expert clinicians, we find that faulty AI can mislead the entire spectrum of clinicians, including experts. Lastly, we show that insights derived from AI class-activation maps can inform improvements in human diagnosis. Together, our approach and findings offer a framework for future studies across the spectrum of image-based diagnostics to improve human–computer collaboration in clinical practice.Keywords
This publication has 38 references indexed in Scilit:
- Classification of the Clinical Images for Benign and Malignant Cutaneous Tumors Using a Deep Learning AlgorithmJournal of Investigative Dermatology, 2018
- Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging challenge: Comparison of the accuracy of computer algorithms to dermatologists for the diagnosis of melanoma from dermoscopic imagesJournal of the American Academy of Dermatology, 2018
- Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural NetworksRadiology, 2017
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Deep Residual Learning for Image RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- ggplot2Published by Springer Science and Business Media LLC ,2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Improving Dermoscopy Image Classification Using Color ConstancyIEEE Journal of Biomedical and Health Informatics, 2014
- Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient OutcomesJAMA, 2005