Clinical integration of machine learning for curative-intent radiation treatment of patients with prostate cancer
Top Cited Papers
- 3 June 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Nature Medicine
- Vol. 27 (6), 999-1005
- https://doi.org/10.1038/s41591-021-01359-w
Abstract
Machine learning (ML) holds great promise for impacting healthcare delivery; however, to date most methods are tested in ‘simulated’ environments that cannot recapitulate factors influencing real-world clinical practice. We prospectively deployed and evaluated a random forest algorithm for therapeutic curative-intent radiation therapy (RT) treatment planning for prostate cancer in a blinded, head-to-head study with full integration into the clinical workflow. ML- and human-generated RT treatment plans were directly compared in a retrospective simulation with retesting (n = 50) and a prospective clinical deployment (n = 50) phase. Consistently throughout the study phases, treating physicians assessed ML- and human-generated RT treatment plans in a blinded manner following a priori defined standardized criteria and peer review processes, with the selected RT plan in the prospective phase delivered for patient treatment. Overall, 89% of ML-generated RT plans were considered clinically acceptable and 72% were selected over human-generated RT plans in head-to-head comparisons. RT planning using ML reduced the median time required for the entire RT planning process by 60.1% (118 to 47 h). While ML RT plan acceptability remained stable between the simulation and deployment phases (92 versus 86%), the number of ML RT plans selected for treatment was significantly reduced (83 versus 61%, respectively). These findings highlight that retrospective or simulated evaluation of ML methods, even under expert blinded review, may not be representative of algorithm acceptance in a real-world clinical setting when patient care is at stake.Funding Information
- Gouvernement du Canada | Canadian Institutes of Health Research
- Gouvernement du Canada | Natural Sciences and Engineering Research Council of Canada
- Princess Margaret Cancer Foundation
This publication has 36 references indexed in Scilit:
- Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studiesBMJ, 2020
- Early prediction of circulatory failure in the intensive care unit using machine learningNature Medicine, 2020
- Axes of a revolution: challenges and promises of big data in healthcareNature Medicine, 2020
- Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networksNature Medicine, 2020
- International evaluation of an AI system for breast cancer screeningNature, 2020
- A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysisThe Lancet Digital Health, 2019
- End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomographyNature Medicine, 2019
- Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural networkNature Medicine, 2019
- Retrospective Validation and Clinical Implementation of Automated Contouring of Organs at Risk in the Head and Neck: A Step Toward Automated Radiation Treatment Planning for Low- and Middle-Income CountriesJournal of Global Oncology, 2018
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017