Multicenter Multireader Evaluation of an Artificial Intelligence-Based Attention Mapping System for the Detection of Prostate Cancer With Multiparametric MRI
- 4 August 2020
- journal article
- research article
- Published by American Roentgen Ray Society in American Journal of Roentgenology
- Vol. 215 (4), 903-912
- https://doi.org/10.2214/AJR.19.22573
Abstract
OBJECTIVE. The purpose of this study was to evaluate in a multicenter dataset the performance of an artificial intelligence (AI) detection system with attention mapping compared with multiparametric MRI (mpMRI) interpretation in the detection of prostate cancer. MATERIALS AND METHODS. MRI examinations from five institutions were included in this study and were evaluated by nine readers. In the first round, readers evaluated mpMRI studies using the Prostate Imaging Reporting and Data System version 2. After 4 weeks, images were again presented to readers along with the AI-based detection system output. Readers accepted or rejected lesions within four AI-generated attention map boxes. Additional lesions outside of boxes were excluded from detection and categorization. The performances of readers using the mpMRI-only and AI-assisted approaches were compared. RESULTS. The study population included 152 case patients and 84 control patients with 274 pathologically proven cancer lesions. The lesion-based AUC was 74.9% for MRI and 77.5% for AI with no significant difference (p = 0.095). The sensitivity for overall detection of cancer lesions was higher for AI than for mpMRI but did not reach statistical significance (57.4% vs 53.6%, p = 0.073). However, for transition zone lesions, sensitivity was higher for AI than for MRI (61.8% vs 50.8%, p = 0.001). Reading time was longer for AI than for MRI (4.66 vs 4.03 minutes, p < 0.001). There was moderate interreader agreement for AI and MRI with no significant difference (58.7% vs 58.5%, p = 0.966). CONCLUSION. Overall sensitivity was only minimally improved by use of the AI system. Significant improvement was achieved, however, in the detection of transition zone lesions with use of the AI system at the cost of a mean of 40 seconds of additional reading time.This publication has 19 references indexed in Scilit:
- Detection of prostate cancer in multiparametric MRI using random forest with instance weightingJournal of Medical Imaging, 2017
- Accuracy and agreement of PIRADSv2 for prostate cancer mpMRI: A multireader studyJournal of Magnetic Resonance Imaging, 2016
- The 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic CarcinomaThe American Journal of Surgical Pathology, 2016
- Investigating the ability of multiparametric MRI to exclude significant prostate cancer prior to transperineal biopsyCanadian Urological Association Journal, 2015
- Satisfaction of Search in Chest Radiography 2015Academic Radiology, 2015
- Characteristics of Detected and Missed Prostate Cancer Foci on 3-T Multiparametric MRI Using an Endorectal Coil Correlated With Whole-Mount Thin-Section HistopathologyAmerican Journal of Roentgenology, 2015
- Use of the Prostate Imaging Reporting and Data System (PI-RADS) for Prostate Cancer Detection with Multiparametric Magnetic Resonance Imaging: A Diagnostic Meta-analysisEuropean Urology, 2015
- Multifocality and Prostate Cancer Detection by Multiparametric Magnetic Resonance Imaging: Correlation with Whole-mount HistopathologyEuropean Urology, 2015
- Regression Forests for Efficient Anatomy Detection and Localization in CT StudiesLecture Notes in Computer Science, 2011
- Anatomy and pathology of the male pelvis by magnetic resonance imagingAmerican Journal of Roentgenology, 1983